2024-02-22T18:27:31.120 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-22T18:27:31.120 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --name yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi --description rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} --archive /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949 -- /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949/orig.config.yaml 2024-02-22T18:27:31.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T18:27:31.244 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949 branch: pacific-release description: rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} email: null first_in_suite: false job_id: '7570949' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: pacific-release ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(PG_ - mons down - pg inactive - out of quorum - \(OSD_ - osds down - osd down sha1: eb66ed921e744301e6863be6353618d63967ea59 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: eb66ed921e744301e6863be6353618d63967ea59 workunit: branch: wip-ksirivad-pacific-release-whitelist sha1: 391ea41edcaa85aa674d6e816fb2469974fc7d8e owner: scheduled_yuriw@teuthology priority: 61 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 264 sha1: eb66ed921e744301e6863be6353618d63967ea59 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-ksirivad-pacific-release-whitelist suite_path: /home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa suite_relpath: qa suite_repo: https://github.com/kamoltat/ceph.git suite_sha1: 391ea41edcaa85aa674d6e816fb2469974fc7d8e targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - cephadm: add_mons_via_daemon_add: true allow_ptrace: false avoid_pacific_features: true cephadm_branch: v15.2.9 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.9 - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=2 --port=8000 - sleep 180 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch ps - ceph versions - ceph -s - ceph orch ls - ceph config set mgr container_image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph versions | jq -e '.mgr | length == 2' - ceph mgr fail - sleep 180 - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph mgr fail - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph versions | jq -e '.mgr | length == 1' - ceph mgr fail - sleep 180 - ceph orch ps - ceph versions - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 2' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.y | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 1' - ceph versions | jq -e '.mon | keys' | grep $sha1 - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 5' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types osd --limit 2 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 7' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd --limit 1 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 8' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 1' - ceph versions | jq -e '.osd | keys' | grep $sha1 - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --services rgw.r.z - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.rgw | length == 1' - ceph versions | jq -e '.rgw | keys' | grep $sha1 - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-22_18:15:46 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-22T18:27:31.245 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa; will attempt to use it 2024-02-22T18:27:31.245 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks 2024-02-22T18:27:31.245 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-22T18:27:31.247 INFO:teuthology.task.internal:Checking packages... 2024-02-22T18:27:31.270 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'eb66ed921e744301e6863be6353618d63967ea59' 2024-02-22T18:27:31.270 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-22T18:27:31.270 INFO:teuthology.packaging:ref: None 2024-02-22T18:27:31.270 INFO:teuthology.packaging:tag: None 2024-02-22T18:27:31.270 INFO:teuthology.packaging:branch: pacific-release 2024-02-22T18:27:31.270 INFO:teuthology.packaging:sha1: eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T18:27:31.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific-release 2024-02-22T18:27:31.417 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-550-geb66ed92-1focal 2024-02-22T18:27:31.418 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-22T18:27:31.426 INFO:teuthology.task.internal:no buildpackages task found 2024-02-22T18:27:31.426 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-22T18:27:31.463 INFO:teuthology.task.internal:Saving configuration 2024-02-22T18:27:31.484 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-22T18:27:31.492 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-22T18:27:31.515 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-22 18:18:38.030787', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-02-22T18:27:31.536 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-22 18:18:38.032583', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-02-22T18:27:31.537 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-22T18:27:31.546 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-02-22T18:27:31.546 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-02-22T18:27:31.546 INFO:teuthology.run_tasks:Running task console_log... 2024-02-22T18:27:31.632 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3cdb3020d0>, signals=[15]) 2024-02-22T18:27:31.632 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-22T18:27:31.638 INFO:teuthology.task.internal:Opening connections... 2024-02-22T18:27:31.638 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-02-22T18:27:31.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:27:31.741 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-02-22T18:27:31.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:27:31.837 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-22T18:27:31.844 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-02-22T18:27:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-02-22T18:27:31.851 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-02-22T18:27:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="20.04" 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=focal 2024-02-22T18:27:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=focal 2024-02-22T18:27:31.901 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-02-22T18:27:31.918 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-02-22T18:27:31.923 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-02-22T18:27:31.924 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="20.04" 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-22T18:27:31.971 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-22T18:27:31.972 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=focal 2024-02-22T18:27:31.972 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=focal 2024-02-22T18:27:31.972 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-02-22T18:27:31.993 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-22T18:27:32.002 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-22T18:27:32.027 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-22T18:27:32.027 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-02-22T18:27:32.030 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-02-22T18:27:32.035 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-22T18:27:32.081 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-22T18:27:32.081 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-02-22T18:27:32.083 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-02-22T18:27:32.112 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-22T18:27:32.159 INFO:teuthology.run_tasks:Running task kernel... 2024-02-22T18:27:32.175 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-22T18:27:32.175 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-22T18:27:32.175 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-22T18:27:32.176 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-22T18:27:32.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T18:27:32.181 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-02-22T18:27:32.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T18:27:32.183 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-02-22T18:27:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:5.4.0-124-generic 2024-02-22T18:27:32.189 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.4.0-124-generic 2024-02-22T18:27:32.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2024-02-22T18:27:32.190 INFO:teuthology.orchestra.run.smithi111.stdout:5.4.0-124-generic 2024-02-22T18:27:32.190 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.4.0-124-generic 2024-02-22T18:27:32.190 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-02-22T18:27:32.336 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2024-02-22T18:27:32.342 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-02-22T18:27:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-02-22T18:27:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-02-22T18:27:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-22T18:27:32.615 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-22T18:27:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-02-22T18:27:32.697 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-02-22T18:27:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,729 kB] 2024-02-22T18:27:32.844 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [710 kB] 2024-02-22T18:27:33.024 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,729 kB] 2024-02-22T18:27:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [710 kB] 2024-02-22T18:27:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-02-22T18:27:33.049 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-02-22T18:27:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [414 kB] 2024-02-22T18:27:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-02-22T18:27:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,572 kB] 2024-02-22T18:27:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [35.5 kB] 2024-02-22T18:27:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [359 kB] 2024-02-22T18:27:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-02-22T18:27:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [645 kB] 2024-02-22T18:27:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [939 kB] 2024-02-22T18:27:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [198 kB] 2024-02-22T18:27:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-02-22T18:27:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2024-02-22T18:27:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.9 kB] 2024-02-22T18:27:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [935 kB] 2024-02-22T18:27:33.181 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [414 kB] 2024-02-22T18:27:33.192 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,109 kB] 2024-02-22T18:27:33.193 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-02-22T18:27:33.193 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [35.5 kB] 2024-02-22T18:27:33.194 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,572 kB] 2024-02-22T18:27:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,796 B] 2024-02-22T18:27:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-02-22T18:27:33.240 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [359 kB] 2024-02-22T18:27:33.247 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-02-22T18:27:33.247 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [645 kB] 2024-02-22T18:27:33.258 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [939 kB] 2024-02-22T18:27:33.269 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [198 kB] 2024-02-22T18:27:33.270 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-02-22T18:27:33.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.9 kB] 2024-02-22T18:27:33.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2024-02-22T18:27:33.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,796 B] 2024-02-22T18:27:33.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-02-22T18:27:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,109 kB] 2024-02-22T18:27:33.581 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [935 kB] 2024-02-22T18:27:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [498 kB] 2024-02-22T18:27:33.610 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [498 kB] 2024-02-22T18:27:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-02-22T18:27:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,689 kB] 2024-02-22T18:27:33.623 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-02-22T18:27:33.623 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.8 kB] 2024-02-22T18:27:33.624 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,689 kB] 2024-02-22T18:27:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.8 kB] 2024-02-22T18:27:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [374 kB] 2024-02-22T18:27:33.696 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [374 kB] 2024-02-22T18:27:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-02-22T18:27:33.711 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-02-22T18:27:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [772 kB] 2024-02-22T18:27:33.875 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,165 kB] 2024-02-22T18:27:34.458 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,165 kB] 2024-02-22T18:27:34.517 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [772 kB] 2024-02-22T18:27:34.556 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [279 kB] 2024-02-22T18:27:34.567 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [279 kB] 2024-02-22T18:27:34.570 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-02-22T18:27:34.571 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.1 kB] 2024-02-22T18:27:34.573 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2024-02-22T18:27:34.573 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,768 B] 2024-02-22T18:27:34.573 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-02-22T18:27:34.574 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-02-22T18:27:34.587 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-02-22T18:27:34.589 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2024-02-22T18:27:34.590 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.1 kB] 2024-02-22T18:27:34.592 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,768 B] 2024-02-22T18:27:34.592 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-02-22T18:27:34.593 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-02-22T18:27:34.595 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-02-22T18:27:34.597 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-02-22T18:27:34.597 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-02-22T18:27:34.598 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-02-22T18:27:34.761 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-02-22T18:27:34.763 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-02-22T18:27:34.924 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-02-22T18:27:34.946 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-02-22T18:27:34.969 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-02-22T18:27:34.975 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-02-22T18:27:37.197 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 19.1 MB in 3s (6,691 kB/s) 2024-02-22T18:27:37.266 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 19.1 MB in 3s (6,765 kB/s) 2024-02-22T18:27:38.696 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-22T18:27:38.721 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-22T18:27:38.730 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-02-22T18:27:38.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-22T18:27:38.791 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-22T18:27:38.830 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-02-22T18:27:38.997 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-02-22T18:27:38.998 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-02-22T18:27:39.042 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-02-22T18:27:39.043 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-02-22T18:27:39.194 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-02-22T18:27:39.194 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-5.4.0-172 linux-headers-5.4.0-172-generic 2024-02-22T18:27:39.194 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-generic linux-image-5.4.0-172-generic 2024-02-22T18:27:39.194 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-5.4.0-172-generic linux-modules-extra-5.4.0-172-generic 2024-02-22T18:27:39.195 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-02-22T18:27:39.195 INFO:teuthology.orchestra.run.smithi111.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-02-22T18:27:39.196 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-02-22T18:27:39.196 INFO:teuthology.orchestra.run.smithi111.stdout: thermald 2024-02-22T18:27:39.245 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2024-02-22T18:27:39.246 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-5.4.0-172 linux-headers-5.4.0-172-generic 2024-02-22T18:27:39.246 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-generic linux-image-5.4.0-172-generic 2024-02-22T18:27:39.246 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-5.4.0-172-generic linux-modules-extra-5.4.0-172-generic 2024-02-22T18:27:39.247 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2024-02-22T18:27:39.247 INFO:teuthology.orchestra.run.smithi040.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-02-22T18:27:39.247 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2024-02-22T18:27:39.247 INFO:teuthology.orchestra.run.smithi040.stdout: thermald 2024-02-22T18:27:39.256 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-02-22T18:27:39.256 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-5.4.0-172 linux-headers-5.4.0-172-generic 2024-02-22T18:27:39.256 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-172-generic linux-modules-5.4.0-172-generic 2024-02-22T18:27:39.256 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-extra-5.4.0-172-generic 2024-02-22T18:27:39.258 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-02-22T18:27:39.258 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-22T18:27:39.326 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2024-02-22T18:27:39.326 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-5.4.0-172 linux-headers-5.4.0-172-generic 2024-02-22T18:27:39.326 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-172-generic linux-modules-5.4.0-172-generic 2024-02-22T18:27:39.327 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-extra-5.4.0-172-generic 2024-02-22T18:27:39.328 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2024-02-22T18:27:39.329 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-22T18:27:39.373 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 5 newly installed, 0 to remove and 286 not upgraded. 2024-02-22T18:27:39.373 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 77.1 MB of archives. 2024-02-22T18:27:39.373 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 380 MB of additional disk space will be used. 2024-02-22T18:27:39.373 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-172-generic amd64 5.4.0-172.190 [15.0 MB] 2024-02-22T18:27:39.512 INFO:teuthology.orchestra.run.smithi040.stdout:3 upgraded, 5 newly installed, 0 to remove and 286 not upgraded. 2024-02-22T18:27:39.512 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 77.1 MB of archives. 2024-02-22T18:27:39.512 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 380 MB of additional disk space will be used. 2024-02-22T18:27:39.513 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-172-generic amd64 5.4.0-172.190 [15.0 MB] 2024-02-22T18:27:40.005 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-172-generic amd64 5.4.0-172.190 [10.5 MB] 2024-02-22T18:27:40.226 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-172-generic amd64 5.4.0-172.190 [39.2 MB] 2024-02-22T18:27:40.684 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-172-generic amd64 5.4.0-172.190 [10.5 MB] 2024-02-22T18:27:40.951 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-172-generic amd64 5.4.0-172.190 [39.2 MB] 2024-02-22T18:27:41.379 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.172.170 [1,900 B] 2024-02-22T18:27:41.380 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.172.170 [2,540 B] 2024-02-22T18:27:41.380 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-172 all 5.4.0-172.190 [11.0 MB] 2024-02-22T18:27:41.598 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-172-generic amd64 5.4.0-172.190 [1,381 kB] 2024-02-22T18:27:41.630 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.172.170 [2,412 B] 2024-02-22T18:27:42.213 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.172.170 [1,900 B] 2024-02-22T18:27:42.213 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.172.170 [2,540 B] 2024-02-22T18:27:42.213 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-172 all 5.4.0-172.190 [11.0 MB] 2024-02-22T18:27:42.325 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 77.1 MB in 2s (32.6 MB/s) 2024-02-22T18:27:42.515 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-5.4.0-172-generic. 2024-02-22T18:27:42.517 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-172-generic amd64 5.4.0-172.190 [1,381 kB] 2024-02-22T18:27:42.562 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.172.170 [2,412 B] 2024-02-22T18:27:43.273 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 77.1 MB in 3s (23.9 MB/s) 2024-02-22T18:27:43.465 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-5.4.0-172-generic. 2024-02-22T18:27:44.301 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-02-22T18:27:44.306 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-linux-modules-5.4.0-172-generic_5.4.0-172.190_amd64.deb ... 2024-02-22T18:27:44.421 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:27:45.145 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-02-22T18:27:45.150 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../0-linux-modules-5.4.0-172-generic_5.4.0-172.190_amd64.deb ... 2024-02-22T18:27:45.271 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:27:46.313 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-image-5.4.0-172-generic. 2024-02-22T18:27:46.327 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-linux-image-5.4.0-172-generic_5.4.0-172.190_amd64.deb ... 2024-02-22T18:27:46.424 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:27:47.255 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-image-5.4.0-172-generic. 2024-02-22T18:27:47.272 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../1-linux-image-5.4.0-172-generic_5.4.0-172.190_amd64.deb ... 2024-02-22T18:27:47.380 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:27:47.525 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-172-generic. 2024-02-22T18:27:47.539 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-172-generic_5.4.0-172.190_amd64.deb ... 2024-02-22T18:27:47.583 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-extra-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:27:48.520 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-172-generic. 2024-02-22T18:27:48.534 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-172-generic_5.4.0-172.190_amd64.deb ... 2024-02-22T18:27:48.574 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-extra-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:27:52.262 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-linux-generic_5.4.0.172.170_amd64.deb ... 2024-02-22T18:27:52.389 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-generic (5.4.0.172.170) over (5.4.0.124.125) ... 2024-02-22T18:27:52.731 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.172.170_amd64.deb ... 2024-02-22T18:27:52.860 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-generic (5.4.0.172.170) over (5.4.0.124.125) ... 2024-02-22T18:27:53.188 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.4.0-172. 2024-02-22T18:27:53.204 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-linux-headers-5.4.0-172_5.4.0-172.190_all.deb ... 2024-02-22T18:27:53.271 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.4.0-172 (5.4.0-172.190) ... 2024-02-22T18:27:53.431 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../3-linux-generic_5.4.0.172.170_amd64.deb ... 2024-02-22T18:27:53.581 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-generic (5.4.0.172.170) over (5.4.0.124.125) ... 2024-02-22T18:27:54.042 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.172.170_amd64.deb ... 2024-02-22T18:27:54.168 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-generic (5.4.0.172.170) over (5.4.0.124.125) ... 2024-02-22T18:27:54.513 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.4.0-172. 2024-02-22T18:27:54.527 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../5-linux-headers-5.4.0-172_5.4.0-172.190_all.deb ... 2024-02-22T18:27:54.571 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.4.0-172 (5.4.0-172.190) ... 2024-02-22T18:27:58.685 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.4.0-172-generic. 2024-02-22T18:27:58.706 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../6-linux-headers-5.4.0-172-generic_5.4.0-172.190_amd64.deb ... 2024-02-22T18:27:58.743 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:00.124 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.4.0-172-generic. 2024-02-22T18:28:00.147 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../6-linux-headers-5.4.0-172-generic_5.4.0-172.190_amd64.deb ... 2024-02-22T18:28:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:01.654 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.172.170_amd64.deb ... 2024-02-22T18:28:01.781 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-generic (5.4.0.172.170) over (5.4.0.124.125) ... 2024-02-22T18:28:02.132 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.4.0-172 (5.4.0-172.190) ... 2024-02-22T18:28:02.244 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:03.170 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.172.170_amd64.deb ... 2024-02-22T18:28:03.289 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-generic (5.4.0.172.170) over (5.4.0.124.125) ... 2024-02-22T18:28:03.488 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:03.589 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-generic (5.4.0.172.170) ... 2024-02-22T18:28:03.648 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.4.0-172 (5.4.0-172.190) ... 2024-02-22T18:28:03.707 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:03.802 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:05.079 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:05.205 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-generic (5.4.0.172.170) ... 2024-02-22T18:28:05.356 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:05.376 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-172-generic 2024-02-22T18:28:05.376 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-172-generic 2024-02-22T18:28:05.593 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-extra-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:06.548 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-172-generic 2024-02-22T18:28:06.548 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-172-generic 2024-02-22T18:28:06.769 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-generic (5.4.0.172.170) ... 2024-02-22T18:28:06.920 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-generic (5.4.0.172.170) ... 2024-02-22T18:28:07.030 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for linux-image-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:07.098 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-22T18:28:07.098 INFO:teuthology.orchestra.run.smithi111.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-172-generic 2024-02-22T18:28:08.367 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-extra-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:09.702 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-generic (5.4.0.172.170) ... 2024-02-22T18:28:09.853 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-generic (5.4.0.172.170) ... 2024-02-22T18:28:10.005 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for linux-image-5.4.0-172-generic (5.4.0-172.190) ... 2024-02-22T18:28:10.084 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-22T18:28:10.084 INFO:teuthology.orchestra.run.smithi040.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-172-generic 2024-02-22T18:28:29.254 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-22T18:28:29.254 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub' 2024-02-22T18:28:29.263 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-22T18:28:29.284 INFO:teuthology.orchestra.run.smithi111.stdout:Generating grub configuration file ... 2024-02-22T18:28:29.626 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-172-generic 2024-02-22T18:28:29.647 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-172-generic 2024-02-22T18:28:30.032 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-02-22T18:28:30.043 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-02-22T18:28:31.807 INFO:teuthology.orchestra.run.smithi111.stdout:done 2024-02-22T18:28:32.191 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-02-22T18:28:32.261 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-02-22T18:28:32.261 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-02-22T18:28:32.261 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-02-22T18:28:32.261 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 20 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.4.0.172.170 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.16) 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.4.0-172-generic, linux-modules-extra-5.4.0-172-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-02-22T18:28:32.262 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-02-22T18:28:32.263 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-172-generic 2024-02-22T18:28:32.263 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-22T18:28:32.263 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-22T18:28:32.263 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-22T18:28:32.263 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-02-22T18:28:32.263 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-02-22T18:28:32.339 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-02-22T18:28:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-22T18:28:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub' 2024-02-22T18:28:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-22T18:28:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:Generating grub configuration file ... 2024-02-22T18:28:32.578 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-22T18:28:32.619 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-02-22T18:28:32.634 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-02-22T18:28:32.666 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-02-22T18:28:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.4.0-172-generic 2024-02-22T18:28:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.4.0-172-generic 2024-02-22T18:28:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-02-22T18:28:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-02-22T18:28:34.353 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-22T18:28:34.377 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-22T18:28:34.442 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-22T18:28:34.631 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-02-22T18:28:34.631 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-02-22T18:28:34.844 INFO:teuthology.orchestra.run.smithi111.stdout:linux-image-generic is already the newest version (5.4.0.172.170). 2024-02-22T18:28:34.844 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 0 newly installed, 0 to remove and 286 not upgraded. 2024-02-22T18:28:34.846 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 20 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.4.0.172.170 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.16) 2024-02-22T18:28:34.867 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.4.0-172-generic, linux-modules-extra-5.4.0-172-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-22T18:28:34.868 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-02-22T18:28:34.868 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-02-22T18:28:34.868 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-02-22T18:28:34.868 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-02-22T18:28:34.868 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-02-22T18:28:34.874 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.BqKO7aVDXv 2024-02-22T18:28:34.875 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub/grub.cfg /tmp/tmp.BqKO7aVDXv 2024-02-22T18:28:34.930 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.BqKO7aVDXv 2024-02-22T18:28:34.965 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.BqKO7aVDXv is 9KB 2024-02-22T18:28:34.979 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.BqKO7aVDXv 2024-02-22T18:28:34.985 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-22T18:28:35.048 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-22T18:28:35.048 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-22T18:28:35.048 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-22T18:28:35.085 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-172-generic 2024-02-22T18:28:35.085 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-grub 2024-02-22T18:28:35.478 INFO:teuthology.orchestra.run.smithi040.stdout:done 2024-02-22T18:28:35.918 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2024-02-22T18:28:35.974 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2024-02-22T18:28:35.974 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2024-02-22T18:28:35.974 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2024-02-22T18:28:35.974 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 20 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.4.0.172.170 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.16) 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.4.0-172-generic, linux-modules-extra-5.4.0-172-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2024-02-22T18:28:35.975 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2024-02-22T18:28:35.975 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-172-generic 2024-02-22T18:28:35.976 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-22T18:28:35.976 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-22T18:28:35.976 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-22T18:28:35.976 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2024-02-22T18:28:35.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2024-02-22T18:28:36.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2024-02-22T18:28:36.261 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-22T18:28:36.261 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-02-22T18:28:36.307 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-02-22T18:28:36.362 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-02-22T18:28:36.422 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub' 2024-02-22T18:28:36.431 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-22T18:28:36.441 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-02-22T18:28:36.683 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-172-generic 2024-02-22T18:28:36.695 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-172-generic 2024-02-22T18:28:37.092 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-02-22T18:28:37.104 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-02-22T18:28:37.848 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-02-22T18:28:37.850 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-02-22T18:28:38.106 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-02-22T18:28:38.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-22T18:28:38.202 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-02-22T18:28:38.391 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-02-22T18:28:38.391 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-02-22T18:28:38.613 INFO:teuthology.orchestra.run.smithi040.stdout:linux-image-generic is already the newest version (5.4.0.172.170). 2024-02-22T18:28:38.613 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 0 newly installed, 0 to remove and 286 not upgraded. 2024-02-22T18:28:38.616 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2024-02-22T18:28:38.639 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2024-02-22T18:28:38.639 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2024-02-22T18:28:38.639 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2024-02-22T18:28:38.639 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2024-02-22T18:28:38.639 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 20 2024-02-22T18:28:38.639 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2024-02-22T18:28:38.639 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2024-02-22T18:28:38.640 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2024-02-22T18:28:38.640 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.4.0.172.170 2024-02-22T18:28:38.640 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.16) 2024-02-22T18:28:38.640 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.4.0-172-generic, linux-modules-extra-5.4.0-172-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-22T18:28:38.641 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2024-02-22T18:28:38.641 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2024-02-22T18:28:38.641 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2024-02-22T18:28:38.641 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2024-02-22T18:28:38.641 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-02-22T18:28:38.647 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.K4FuaQLj0t 2024-02-22T18:28:38.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub/grub.cfg /tmp/tmp.K4FuaQLj0t 2024-02-22T18:28:38.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.K4FuaQLj0t 2024-02-22T18:28:38.737 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.K4FuaQLj0t is 9KB 2024-02-22T18:28:38.751 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.K4FuaQLj0t 2024-02-22T18:28:38.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-22T18:28:38.814 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:28:38.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-22T18:28:38.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-22T18:28:38.842 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-172-generic 2024-02-22T18:28:38.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo update-grub 2024-02-22T18:28:40.183 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub' 2024-02-22T18:28:40.190 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-22T18:28:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-02-22T18:28:40.574 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.4.0-172-generic 2024-02-22T18:28:40.585 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.4.0-172-generic 2024-02-22T18:28:41.020 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-02-22T18:28:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-02-22T18:28:42.019 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-02-22T18:28:42.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-02-22T18:29:07.875 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-22T18:29:07.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-22T18:29:07.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:29:12.028 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-22T18:29:12.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-22T18:29:12.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:29:42.336 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-02-22T18:29:51.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-22T18:29:51.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:29:54.400 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-02-22T18:30:06.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-22T18:30:06.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:30:12.036 DEBUG:teuthology.orchestra.remote:timed out 2024-02-22T18:30:21.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-22T18:30:21.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:30:21.047 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-02-22T18:30:33.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-22T18:30:33.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:30:33.305 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-02-22T18:30:33.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-22T18:30:33.912 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-172-generic"... 2024-02-22T18:30:33.912 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-02-22T18:30:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:5.4.0-172-generic 2024-02-22T18:30:33.918 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-172-generic vs 5.4.0-172-generic 2024-02-22T18:30:33.918 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-22T18:30:33.918 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-22T18:30:34.919 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-22T18:30:34.919 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-22T18:30:35.019 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2024-02-22T18:30:35.047 DEBUG:teuthology.parallel:result is None 2024-02-22T18:30:38.114 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-02-22T18:30:38.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-22T18:30:38.714 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-172-generic"... 2024-02-22T18:30:38.714 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-02-22T18:30:38.720 INFO:teuthology.orchestra.run.smithi111.stdout:5.4.0-172-generic 2024-02-22T18:30:38.720 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-172-generic vs 5.4.0-172-generic 2024-02-22T18:30:38.720 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-22T18:30:38.721 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-22T18:30:39.721 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-22T18:30:39.722 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-22T18:30:39.823 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-02-22T18:30:39.842 DEBUG:teuthology.parallel:result is None 2024-02-22T18:30:39.843 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-22T18:30:39.850 INFO:teuthology.task.internal:Creating test directory... 2024-02-22T18:30:39.850 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-22T18:30:39.853 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-22T18:30:39.859 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-22T18:30:39.887 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-22T18:30:39.920 INFO:teuthology.task.internal:Creating archive directory... 2024-02-22T18:30:39.921 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-22T18:30:39.923 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-22T18:30:39.946 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-22T18:30:39.953 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-22T18:30:39.953 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-22T18:30:39.955 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-22T18:30:39.978 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-22T18:30:39.989 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-22T18:30:40.001 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-22T18:30:40.010 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-22T18:30:40.012 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-22T18:30:40.019 INFO:teuthology.task.internal:Configuring sudo... 2024-02-22T18:30:40.019 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-22T18:30:40.021 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-22T18:30:40.035 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-22T18:30:40.047 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-22T18:30:40.047 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-22T18:30:40.079 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-22T18:30:40.086 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-22T18:30:40.093 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-22T18:30:40.100 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:30:40.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-22T18:30:40.167 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-22T18:30:40.174 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-22T18:30:40.181 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-22T18:30:40.181 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-22T18:30:40.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-02-22T18:30:40.251 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-02-22T18:30:40.303 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-22T18:30:40.311 INFO:teuthology.task.internal:Starting timer... 2024-02-22T18:30:40.311 INFO:teuthology.run_tasks:Running task pcp... 2024-02-22T18:30:40.332 INFO:teuthology.run_tasks:Running task selinux... 2024-02-22T18:30:40.364 DEBUG:teuthology.task.selinux:Excluding smithi040: OS 'ubuntu' does not support SELinux 2024-02-22T18:30:40.364 DEBUG:teuthology.task.selinux:Excluding smithi111: OS 'ubuntu' does not support SELinux 2024-02-22T18:30:40.364 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-22T18:30:40.365 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-02-22T18:30:40.365 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-22T18:30:40.365 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-22T18:30:40.398 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-22T18:30:40.414 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-22T18:30:40.416 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi111.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-22T18:36:06.564 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com')] 2024-02-22T18:36:06.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-22T18:36:06.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:36:06.667 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-02-22T18:36:06.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-22T18:36:06.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-22T18:36:06.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:36:06.892 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-02-22T18:36:07.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-22T18:36:07.022 INFO:teuthology.run_tasks:Running task clock... 2024-02-22T18:36:07.033 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-22T18:36:07.033 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-22T18:36:07.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T18:36:07.036 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-22T18:36:07.036 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T18:36:07.068 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-02-22T18:36:07.068 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: Command line: ntpd -gq 2024-02-22T18:36:07.069 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: proto: precision = 0.182 usec (-22) 2024-02-22T18:36:07.069 INFO:teuthology.orchestra.run.smithi040.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-22T18:36:07.069 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-22T18:36:07.069 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: restrict ::: KOD does nothing without LIMITED. 2024-02-22T18:36:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-22T18:36:07.070 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: Listen and drop on 0 v6wildcard [::]:123 2024-02-22T18:36:07.071 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-22T18:36:07.071 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: Listen normally on 2 lo 127.0.0.1:123 2024-02-22T18:36:07.071 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: Listen normally on 3 ens1f0 172.21.15.40:123 2024-02-22T18:36:07.071 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: Listen normally on 4 lo [::1]:123 2024-02-22T18:36:07.071 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12cc%4]:123 2024-02-22T18:36:07.071 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:07 ntpd[12805]: Listening on routing socket on fd #22 for interface updates 2024-02-22T18:36:07.071 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-02-22T18:36:07.072 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: Command line: ntpd -gq 2024-02-22T18:36:07.072 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: proto: precision = 0.093 usec (-23) 2024-02-22T18:36:07.072 INFO:teuthology.orchestra.run.smithi111.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-22T18:36:07.072 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-22T18:36:07.073 INFO:teuthology.orchestra.run.smithi111.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-22T18:36:07.073 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: restrict ::: KOD does nothing without LIMITED. 2024-02-22T18:36:07.074 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: Listen and drop on 0 v6wildcard [::]:123 2024-02-22T18:36:07.074 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-22T18:36:07.074 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: Listen normally on 2 lo 127.0.0.1:123 2024-02-22T18:36:07.074 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: Listen normally on 3 enp3s0f1 172.21.15.111:123 2024-02-22T18:36:07.074 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: Listen normally on 4 lo [::1]:123 2024-02-22T18:36:07.074 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc2f%5]:123 2024-02-22T18:36:07.074 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:07 ntpd[12933]: Listening on routing socket on fd #22 for interface updates 2024-02-22T18:36:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:08 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:08 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:08 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:08 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:08 ntpd[12805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:08 ntpd[12805]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:08.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:08 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:08.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:08 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:08.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:08 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:08.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:08 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:08.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:08 ntpd[12933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:08.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:08 ntpd[12933]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:09.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:09 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:09.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:09 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:10 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:10 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:10 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:10 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:10 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:10 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:10 ntpd[12805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:10 ntpd[12805]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:10.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:10 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:10.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:10 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:10.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:10 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:10.070 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:10 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:10.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:10 ntpd[12933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:10.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:10 ntpd[12933]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:11.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:11.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:11.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:11.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:11.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:11.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:11.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:11.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:11 ntpd[12805]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:12 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:12.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:12 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:12.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:12 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:12.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:12 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:12.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:12 ntpd[12805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:12.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:12 ntpd[12805]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:12 ntpd[12933]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:13.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:13.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:13.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:13.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:13 ntpd[12805]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:14.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:14 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:14.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:14 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:14.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:14 ntpd[12805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:14.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:14 ntpd[12805]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:14.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:14 ntpd[12805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:14.069 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:14 ntpd[12805]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:14.069 INFO:teuthology.orchestra.run.smithi040.stdout:22 Feb 18:36:14 ntpd[12805]: ntpd: time slew +0.004639 s 2024-02-22T18:36:14.069 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd: time slew +0.004639s 2024-02-22T18:36:14.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:14 ntpd[12805]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-22T18:36:14.070 INFO:teuthology.orchestra.run.smithi040.stderr:22 Feb 18:36:14 ntpd[12805]: can't open /var/log/ntpstats/loopstats.20240222: Permission denied 2024-02-22T18:36:14.071 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: can't open /var/log/ntpstats/rawstats.20240222: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-22T18:36:14.072 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: can't open /var/log/ntpstats/peerstats.20240222: Permission denied 2024-02-22T18:36:14.073 INFO:teuthology.orchestra.run.smithi111.stdout:22 Feb 18:36:14 ntpd[12933]: ntpd: time slew +0.000814 s 2024-02-22T18:36:14.073 INFO:teuthology.orchestra.run.smithi111.stdout:ntpd: time slew +0.000814s 2024-02-22T18:36:14.073 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-22T18:36:14.073 INFO:teuthology.orchestra.run.smithi111.stderr:22 Feb 18:36:14 ntpd[12933]: can't open /var/log/ntpstats/loopstats.20240222: Permission denied 2024-02-22T18:36:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-02-22T18:36:14.132 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-02-22T18:36:14.132 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-22T18:36:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-22T18:36:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-22T18:36:14.133 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-22T18:36:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2024-02-22T18:36:14.133 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2024-02-22T18:36:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-22T18:36:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-22T18:36:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-22T18:36:14.133 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-22T18:36:14.133 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-22T18:36:14.200 INFO:tasks.cephadm:Config: {'add_mons_via_daemon_add': True, 'allow_ptrace': False, 'avoid_pacific_features': True, 'cephadm_branch': 'v15.2.9', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.9', 'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', '\\(PG_', 'mons down', 'pg inactive', 'out of quorum', '\\(OSD_', 'osds down', 'osd down'], 'sha1': 'eb66ed921e744301e6863be6353618d63967ea59'} 2024-02-22T18:36:14.200 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.9 2024-02-22T18:36:14.201 INFO:tasks.cephadm:Cluster fsid is 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:36:14.201 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-22T18:36:14.201 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.40', 'mon.c': '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]', 'mon.b': '172.21.15.111'} 2024-02-22T18:36:14.201 INFO:tasks.cephadm:First mon is mon.a on smithi040 2024-02-22T18:36:14.201 INFO:tasks.cephadm:First mgr is y 2024-02-22T18:36:14.202 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-22T18:36:14.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname $(hostname -s) 2024-02-22T18:36:14.219 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname $(hostname -s) 2024-02-22T18:36:14.237 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.9)... 2024-02-22T18:36:14.237 DEBUG:teuthology.orchestra.run.smithi040:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.9/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-22T18:36:14.570 INFO:teuthology.orchestra.run.smithi040.stdout:-rw-rw-r-- 1 ubuntu ubuntu 219588 Feb 22 18:36 /home/ubuntu/cephtest/cephadm 2024-02-22T18:36:14.570 DEBUG:teuthology.orchestra.run.smithi111:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.9/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-22T18:36:14.789 INFO:teuthology.orchestra.run.smithi111.stdout:-rw-rw-r-- 1 ubuntu ubuntu 219588 Feb 22 18:36 /home/ubuntu/cephtest/cephadm 2024-02-22T18:36:14.789 DEBUG:teuthology.orchestra.run.smithi040:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-22T18:36:14.798 DEBUG:teuthology.orchestra.run.smithi111:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-22T18:36:14.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph 2024-02-22T18:36:14.834 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph 2024-02-22T18:36:14.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /etc/ceph 2024-02-22T18:36:14.892 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /etc/ceph 2024-02-22T18:36:14.908 INFO:tasks.cephadm:Writing seed config... 2024-02-22T18:36:14.908 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-02-22T18:36:14.909 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-22T18:36:14.909 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-22T18:36:14.909 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-22T18:36:14.909 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-22T18:36:14.909 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-22T18:36:14.909 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-22T18:36:14.909 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-22T18:36:14.909 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:36:14.910 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-22T18:36:14.916 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 42039b9c-d1b1-11ee-95bf-87774f69a715 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-02-22T18:36:14.917 DEBUG:teuthology.orchestra.run.smithi040:mon.a> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a.service 2024-02-22T18:36:14.962 DEBUG:teuthology.orchestra.run.smithi040:mgr.y> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y.service 2024-02-22T18:36:14.964 INFO:tasks.cephadm:Bootstrapping... 2024-02-22T18:36:14.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 -v bootstrap --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.40 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-22T18:36:15.170 INFO:teuthology.orchestra.run.smithi040.stderr:Could not locate podman: podman not found 2024-02-22T18:36:15.170 INFO:teuthology.orchestra.run.smithi040.stderr:Verifying podman|docker is present... 2024-02-22T18:36:15.170 INFO:teuthology.orchestra.run.smithi040.stderr:Verifying lvm2 is present... 2024-02-22T18:36:15.170 INFO:teuthology.orchestra.run.smithi040.stderr:Verifying time synchronization is in place... 2024-02-22T18:36:15.170 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled chrony.service 2024-02-22T18:36:15.175 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-22T18:36:15.175 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active chrony.service 2024-02-22T18:36:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout inactive 2024-02-22T18:36:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled chronyd.service 2024-02-22T18:36:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-02-22T18:36:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active chronyd.service 2024-02-22T18:36:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout inactive 2024-02-22T18:36:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2024-02-22T18:36:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout masked 2024-02-22T18:36:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active systemd-timesyncd.service 2024-02-22T18:36:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout inactive 2024-02-22T18:36:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled ntpd.service 2024-02-22T18:36:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-02-22T18:36:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active ntpd.service 2024-02-22T18:36:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout inactive 2024-02-22T18:36:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled ntp.service 2024-02-22T18:36:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout enabled 2024-02-22T18:36:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active ntp.service 2024-02-22T18:36:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout active 2024-02-22T18:36:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:Unit ntp.service is enabled and running 2024-02-22T18:36:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:Repeating the final host check... 2024-02-22T18:36:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:Could not locate podman: podman not found 2024-02-22T18:36:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:podman|docker (/usr/bin/docker) is present 2024-02-22T18:36:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl is present 2024-02-22T18:36:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:lvcreate is present 2024-02-22T18:36:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled chrony.service 2024-02-22T18:36:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-22T18:36:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active chrony.service 2024-02-22T18:36:15.248 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout inactive 2024-02-22T18:36:15.248 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled chronyd.service 2024-02-22T18:36:15.254 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-02-22T18:36:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active chronyd.service 2024-02-22T18:36:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout inactive 2024-02-22T18:36:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2024-02-22T18:36:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout masked 2024-02-22T18:36:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active systemd-timesyncd.service 2024-02-22T18:36:15.274 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout inactive 2024-02-22T18:36:15.274 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled ntpd.service 2024-02-22T18:36:15.281 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-02-22T18:36:15.282 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active ntpd.service 2024-02-22T18:36:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout inactive 2024-02-22T18:36:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-enabled ntp.service 2024-02-22T18:36:15.296 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout enabled 2024-02-22T18:36:15.296 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl is-active ntp.service 2024-02-22T18:36:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stdout active 2024-02-22T18:36:15.302 INFO:teuthology.orchestra.run.smithi040.stderr:Unit ntp.service is enabled and running 2024-02-22T18:36:15.302 INFO:teuthology.orchestra.run.smithi040.stderr:Host looks OK 2024-02-22T18:36:15.302 INFO:teuthology.orchestra.run.smithi040.stderr:Cluster fsid: 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:36:15.302 INFO:teuthology.orchestra.run.smithi040.stderr:Acquiring lock 139758869241232 on /run/cephadm/42039b9c-d1b1-11ee-95bf-87774f69a715.lock 2024-02-22T18:36:15.303 INFO:teuthology.orchestra.run.smithi040.stderr:Lock 139758869241232 acquired on /run/cephadm/42039b9c-d1b1-11ee-95bf-87774f69a715.lock 2024-02-22T18:36:15.303 INFO:teuthology.orchestra.run.smithi040.stderr:Verifying IP 172.21.15.40 port 3300 ... 2024-02-22T18:36:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:Verifying IP 172.21.15.40 port 6789 ... 2024-02-22T18:36:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:Base mon IP is 172.21.15.40, final addrv is [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-02-22T18:36:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/sbin/ip route ls 2024-02-22T18:36:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2024-02-22T18:36:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-02-22T18:36:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.40 2024-02-22T18:36:15.309 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/sbin/ip -6 route ls 2024-02-22T18:36:15.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-22T18:36:15.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-02-22T18:36:15.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1671sec hoplimit 64 pref medium 2024-02-22T18:36:15.312 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/sbin/ip -6 addr ls 2024-02-22T18:36:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-22T18:36:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-22T18:36:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-22T18:36:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-22T18:36:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-02-22T18:36:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-22T18:36:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:Mon IP 172.21.15.40 is in CIDR network 172.21.0.0/20 2024-02-22T18:36:15.317 INFO:teuthology.orchestra.run.smithi040.stderr:Pulling container image docker.io/ceph/ceph:v15.2.9... 2024-02-22T18:36:15.318 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker pull docker.io/ceph/ceph:v15.2.9 2024-02-22T18:36:15.416 INFO:journalctl@ceph.mon.a.smithi040.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:36:15.445 INFO:journalctl@ceph.mgr.y.smithi040.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:36:19.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout v15.2.9: Pulling from ceph/ceph 2024-02-22T18:36:19.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout 7a0437f04f83: Pulling fs layer 2024-02-22T18:36:19.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout 008f517fda00: Pulling fs layer 2024-02-22T18:36:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout 7a0437f04f83: Verifying Checksum 2024-02-22T18:36:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout 7a0437f04f83: Download complete 2024-02-22T18:36:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout 7a0437f04f83: Pull complete 2024-02-22T18:36:27.134 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout 008f517fda00: Verifying Checksum 2024-02-22T18:36:27.134 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout 008f517fda00: Download complete 2024-02-22T18:36:40.095 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout 008f517fda00: Pull complete 2024-02-22T18:36:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout Digest: sha256:ffc5c6c93b4ff584400eab951ae5d41ef0042031c96fb539b50f75cca5c68548 2024-02-22T18:36:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout Status: Downloaded newer image for ceph/ceph:v15.2.9 2024-02-22T18:36:40.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/docker: stdout docker.io/ceph/ceph:v15.2.9 2024-02-22T18:36:40.287 INFO:teuthology.orchestra.run.smithi040.stderr:Extracting ceph user uid/gid from container image... 2024-02-22T18:36:40.287 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint stat -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 docker.io/ceph/ceph:v15.2.9 -c %u %g /var/lib/ceph 2024-02-22T18:36:50.339 INFO:teuthology.orchestra.run.smithi040.stderr:stat: stdout 167 167 2024-02-22T18:36:50.990 INFO:teuthology.orchestra.run.smithi040.stderr:Creating initial keys... 2024-02-22T18:36:50.990 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 docker.io/ceph/ceph:v15.2.9 --gen-print-key 2024-02-22T18:36:51.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-authtool: stdout AQBDlNdlYrPQLxAAiUP1S5OxclnRg2lfvLjcmA== 2024-02-22T18:36:52.426 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 docker.io/ceph/ceph:v15.2.9 --gen-print-key 2024-02-22T18:36:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-authtool: stdout AQBFlNdlyIogDBAAJvnVZ5Q+/ljSXXy35ATcjQ== 2024-02-22T18:36:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 docker.io/ceph/ceph:v15.2.9 --gen-print-key 2024-02-22T18:36:54.737 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-authtool: stdout AQBGlNdlVWzhKxAAjymPwvB5+GMTrjknFSDrpA== 2024-02-22T18:36:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:Creating initial monmap... 2024-02-22T18:36:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/monmaptool -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /tmp/ceph-tmpryej0m3y:/tmp/monmap:z docker.io/ceph/ceph:v15.2.9 --create --clobber --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 --addv a [v2:172.21.15.40:3300,v1:172.21.15.40:6789] /tmp/monmap 2024-02-22T18:36:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-22T18:36:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:36:56.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-22T18:36:56.731 INFO:teuthology.orchestra.run.smithi040.stderr:Creating mon... 2024-02-22T18:36:56.734 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-mon -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpy1vwmnjl:/tmp/keyring:z -v /tmp/ceph-tmpryej0m3y:/tmp/monmap:z docker.io/ceph/ceph:v15.2.9 --mkfs -i a --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2024-02-22T18:36:57.586 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.579+0000 7f00090b0700 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T18:36:57.586 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 1 imported monmap: 2024-02-22T18:36:57.586 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr epoch 0 2024-02-22T18:36:57.586 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:36:57.586 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr last_changed 2024-02-22T18:36:56.041700+0000 2024-02-22T18:36:57.587 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr created 2024-02-22T18:36:56.041700+0000 2024-02-22T18:36:57.587 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr min_mon_release 0 (unknown) 2024-02-22T18:36:57.587 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-02-22T18:36:57.588 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.588 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 0 /usr/bin/ceph-mon: set fsid to 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:36:57.590 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 0 set rocksdb option compression = kNoCompression 2024-02-22T18:36:57.590 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T18:36:57.590 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T18:36:57.590 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 0 set rocksdb option compression = kNoCompression 2024-02-22T18:36:57.590 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T18:36:57.590 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T18:36:57.590 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: RocksDB version: 6.1.2 2024-02-22T18:36:57.590 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.591 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T18:36:57.591 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Compile date Feb 23 2021 2024-02-22T18:36:57.591 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: DB SUMMARY 2024-02-22T18:36:57.591 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.591 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-02-22T18:36:57.591 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.591 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-02-22T18:36:57.591 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.619 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.error_if_exists: 0 2024-02-22T18:36:57.619 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.create_if_missing: 1 2024-02-22T18:36:57.619 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T18:36:57.619 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.env: 0x56347f1691a0 2024-02-22T18:36:57.619 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.info_log: 0x563480769520 2024-02-22T18:36:57.619 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T18:36:57.619 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.statistics: (nil) 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.use_fsync: 0 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.db_log_dir: 2024-02-22T18:36:57.620 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.write_buffer_manager: 0x5634807c64b0 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T18:36:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.row_cache: None 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.wal_filter: None 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.two_write_queues: 0 2024-02-22T18:36:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.atomic_flush: 0 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.max_open_files: -1 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T18:36:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Compression algorithms supported: 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: kZSTD supported: 0 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: kXpressCompression supported: 0 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: kZlibCompression supported: 1 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.583+0000 7f00090b0700 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-02-22T18:36:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.merge_operator: 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_filter: None 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5634806fd0c0) 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 1 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr index_type: 0 2024-02-22T18:36:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr hash_index_allow_collision: 1 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr checksum: 1 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr block_cache: 0x563480734510 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr block_cache_options: 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr block_size: 4096 2024-02-22T18:36:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr format_version: 2 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr block_align: 0 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T18:36:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compression: NoCompression 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.num_levels: 7 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T18:36:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T18:36:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T18:36:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.table_properties_collectors: 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.bloom_locality: 0 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T18:36:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.587+0000 7f00090b0700 4 rocksdb: Options.ttl: 0 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.595+0000 7f00090b0700 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.595+0000 7f00090b0700 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.595+0000 7f00090b0700 4 rocksdb: DB pointer 0x563481360400 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.595+0000 7efff1f90700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.595+0000 7efff1f90700 4 rocksdb: [db/db_impl.cc:778] 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T18:36:57.632 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:36:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-02-22T18:36:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:36:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:36:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T18:36:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-02-22T18:36:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr 2024-02-22T18:36:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.599+0000 7f00090b0700 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2024-02-22T18:36:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.599+0000 7f00090b0700 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2024-02-22T18:36:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph-mon: stderr "debug "2024-02-22T18:36:57.599+0000 7f00090b0700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-02-22T18:36:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:36:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl disable ceph.target 2024-02-22T18:36:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl enable ceph.target 2024-02-22T18:36:58.398 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-02-22T18:36:58.562 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl start ceph.target 2024-02-22T18:36:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl enable ceph-42039b9c-d1b1-11ee-95bf-87774f69a715.target 2024-02-22T18:36:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715.target -> /etc/systemd/system/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715.target. 2024-02-22T18:36:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715.target -> /etc/systemd/system/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715.target. 2024-02-22T18:36:58.744 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl start ceph-42039b9c-d1b1-11ee-95bf-87774f69a715.target 2024-02-22T18:36:58.751 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl daemon-reload 2024-02-22T18:36:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a 2024-02-22T18:36:58.956 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl reset-failed ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a 2024-02-22T18:36:58.961 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Failed to reset failed state of unit ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a.service: Unit ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a.service not loaded. 2024-02-22T18:36:58.961 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl enable ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a 2024-02-22T18:36:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Created symlink /etc/systemd/system/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715.target.wants/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a.service -> /etc/systemd/system/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@.service. 2024-02-22T18:36:59.131 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl start ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a 2024-02-22T18:36:59.140 INFO:teuthology.orchestra.run.smithi040.stderr:firewalld does not appear to be present 2024-02-22T18:36:59.141 INFO:teuthology.orchestra.run.smithi040.stderr:Not possible to enable service . firewalld.service is not available 2024-02-22T18:36:59.141 INFO:teuthology.orchestra.run.smithi040.stderr:Not possible to open ports <[]>. firewalld.service is not available 2024-02-22T18:36:59.141 INFO:teuthology.orchestra.run.smithi040.stderr:Waiting for mon to start... 2024-02-22T18:36:59.141 INFO:teuthology.orchestra.run.smithi040.stderr:Waiting for mon... 2024-02-22T18:36:59.141 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 status 2024-02-22T18:37:00.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:00 smithi040 bash[13545]: cluster 2024-02-22T18:37:00.483748+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-22T18:37:00.716 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout cluster: 2024-02-22T18:37:00.717 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout id: 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:37:00.717 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-22T18:37:00.717 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:00.718 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout services: 2024-02-22T18:37:00.718 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.222059s) 2024-02-22T18:37:00.718 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-22T18:37:00.718 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-22T18:37:00.718 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:00.719 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout data: 2024-02-22T18:37:00.719 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-22T18:37:00.719 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-22T18:37:00.719 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-22T18:37:00.719 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout pgs: 2024-02-22T18:37:00.719 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:01.335 INFO:teuthology.orchestra.run.smithi040.stderr:mon is available 2024-02-22T18:37:01.335 INFO:teuthology.orchestra.run.smithi040.stderr:Assimilating anything we can from ceph.conf... 2024-02-22T18:37:01.336 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z -v /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z docker.io/ceph/ceph:v15.2.9 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2024-02-22T18:37:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:01 smithi040 bash[13545]: cluster 2024-02-22T18:37:00.493206+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-22T18:37:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:01 smithi040 bash[13545]: cluster 2024-02-22T18:37:00.493487+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0]} 2024-02-22T18:37:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:01 smithi040 bash[13545]: cluster 2024-02-22T18:37:00.497514+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-22T18:37:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:01 smithi040 bash[13545]: cluster 2024-02-22T18:37:00.501799+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-22T18:37:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:01 smithi040 bash[13545]: cluster 2024-02-22T18:37:00.502521+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-22T18:37:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:01 smithi040 bash[13545]: audit 2024-02-22T18:37:00.715207+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.40:0/590744321' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:37:02.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:02.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout [global] 2024-02-22T18:37:02.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout fsid = 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:37:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout log_to_journald = false 2024-02-22T18:37:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mon_election_default_strategy = 3 2024-02-22T18:37:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-02-22T18:37:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-22T18:37:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-22T18:37:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-22T18:37:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-22T18:37:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout [mgr] 2024-02-22T18:37:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-22T18:37:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout [mon] 2024-02-22T18:37:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mon_warn_on_insecure_global_id_reclaim = false 2024-02-22T18:37:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-22T18:37:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout [osd] 2024-02-22T18:37:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-22T18:37:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout osd_memory_target_autotune = true 2024-02-22T18:37:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-22T18:37:02.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:02 smithi040 bash[13545]: audit 2024-02-22T18:37:02.295556+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.40:0/1455754508' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-22T18:37:02.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:02 smithi040 bash[13545]: audit 2024-02-22T18:37:02.299116+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.40:0/1455754508' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-22T18:37:02.941 INFO:teuthology.orchestra.run.smithi040.stderr:Generating new minimal ceph.conf... 2024-02-22T18:37:02.941 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z -v /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z docker.io/ceph/ceph:v15.2.9 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2024-02-22T18:37:04.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:03 smithi040 bash[13545]: audit 2024-02-22T18:37:03.922555+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.40:0/3175124859' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:37:04.468 INFO:teuthology.orchestra.run.smithi040.stderr:Restarting the monitor... 2024-02-22T18:37:04.468 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl restart ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a 2024-02-22T18:37:04.801 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:04 smithi040 systemd[1]: Stopping Ceph mon.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T18:37:04.801 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:04 smithi040 bash[13545]: debug 2024-02-22T18:37:04.559+0000 7f2542ad6700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T18:37:04.801 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:04 smithi040 bash[13545]: debug 2024-02-22T18:37:04.559+0000 7f2542ad6700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-22T18:37:05.353 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:05 smithi040 docker[13932]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-mon.a 2024-02-22T18:37:05.358 INFO:teuthology.orchestra.run.smithi040.stderr:Setting mon public_network... 2024-02-22T18:37:05.359 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 config set mon public_network 172.21.0.0/20 2024-02-22T18:37:05.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:05 smithi040 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a.service: Succeeded. 2024-02-22T18:37:05.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:05 smithi040 systemd[1]: Stopped Ceph mon.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:37:05.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:05 smithi040 systemd[1]: Started Ceph mon.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:37:06.489 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.479+0000 7fcb95a9e700 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.479+0000 7fcb95a9e700 0 ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable), process ceph-mon, pid 1 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.479+0000 7fcb95a9e700 0 pidfile_write: ignore empty --pid-file 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 0 load: jerasure load: lrc load: isa 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 0 set rocksdb option compression = kNoCompression 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 0 set rocksdb option compression = kNoCompression 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 1 rocksdb: do_open column families: [default] 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: RocksDB version: 6.1.2 2024-02-22T18:37:06.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Compile date Feb 23 2021 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: DB SUMMARY 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: CURRENT file: CURRENT 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: IDENTITY file: IDENTITY 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69391 ; 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.error_if_exists: 0 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.create_if_missing: 0 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.env: 0x561367d7f1a0 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.info_log: 0x561369788ba0 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.statistics: (nil) 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.use_fsync: 0 2024-02-22T18:37:06.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T18:37:06.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T18:37:06.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T18:37:06.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T18:37:06.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T18:37:06.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T18:37:06.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T18:37:06.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T18:37:06.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T18:37:06.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T18:37:06.493 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T18:37:06.493 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.db_log_dir: 2024-02-22T18:37:06.493 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-22T18:37:06.493 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T18:37:06.493 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T18:37:06.493 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T18:37:06.493 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T18:37:06.493 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T18:37:06.767 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T18:37:06.767 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T18:37:06.767 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T18:37:06.767 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T18:37:06.767 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.write_buffer_manager: 0x56136976d2f0 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T18:37:06.768 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.row_cache: None 2024-02-22T18:37:06.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.wal_filter: None 2024-02-22T18:37:06.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T18:37:06.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T18:37:06.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T18:37:06.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.two_write_queues: 0 2024-02-22T18:37:06.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T18:37:06.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.atomic_flush: 0 2024-02-22T18:37:06.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T18:37:06.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T18:37:06.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T18:37:06.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T18:37:06.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T18:37:06.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T18:37:06.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T18:37:06.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T18:37:06.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T18:37:06.770 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_open_files: -1 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Compression algorithms supported: 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: kZSTD supported: 0 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: kXpressCompression supported: 0 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: kZlibCompression supported: 1 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T18:37:06.771 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.merge_operator: 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_filter: None 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5613696a30d0) 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: cache_index_and_filter_blocks: 1 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: cache_index_and_filter_blocks_with_high_priority: 1 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: pin_top_level_index_and_filter: 1 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: index_type: 0 2024-02-22T18:37:06.772 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: data_block_index_type: 0 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: data_block_hash_table_util_ratio: 0.750000 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: hash_index_allow_collision: 1 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: checksum: 1 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: no_block_cache: 0 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: block_cache: 0x5613696da610 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: block_cache_name: BinnedLRUCache 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: block_cache_options: 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: capacity : 536870912 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: num_shard_bits : 4 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: strict_capacity_limit : 0 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: high_pri_pool_ratio: 0.000 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: block_cache_compressed: (nil) 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: persistent_cache: (nil) 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: block_size: 4096 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: block_size_deviation: 10 2024-02-22T18:37:06.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: block_restart_interval: 16 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: index_block_restart_interval: 1 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: metadata_block_size: 4096 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: partition_filters: 0 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: use_delta_encoding: 1 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: whole_key_filtering: 1 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: verify_compression: 0 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: read_amp_bytes_per_bit: 0 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: format_version: 2 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: enable_index_compression: 1 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: block_align: 0 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compression: NoCompression 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T18:37:06.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.num_levels: 7 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T18:37:06.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T18:37:06.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T18:37:06.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.table_properties_collectors: 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.bloom_locality: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: Options.ttl: 0 2024-02-22T18:37:06.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708627026487917, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.483+0000 7fcb95a9e700 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.487+0000 7fcb95a9e700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708627026489433, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66432, "table_properties": {"data_size": 64727, "index_size": 310, "filter_size": 581, "raw_key_size": 8761, "raw_average_key_size": 46, "raw_value_size": 59686, "raw_average_value_size": 319, "num_data_blocks": 10, "num_entries": 187, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.487+0000 7fcb95a9e700 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.487+0000 7fcb95a9e700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708627026490084, "job": 1, "event": "recovery_finished"} 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.487+0000 7fcb95a9e700 4 rocksdb: DB pointer 0x56136a306400 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.487+0000 7fcb7c909700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.487+0000 7fcb7c909700 4 rocksdb: [db/db_impl.cc:778] 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ** DB Stats ** 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T18:37:06.779 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T18:37:06.780 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T18:37:06.780 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T18:37:06.780 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ** Compaction Stats [default] ** 2024-02-22T18:37:06.780 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:37:06.780 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:37:06.780 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: L0 2/0 66.50 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 55.5 0.00 0.00 1 0.001 0 0 2024-02-22T18:37:06.780 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Sum 2/0 66.50 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 55.5 0.00 0.00 1 0.001 0 0 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 55.5 0.00 0.00 1 0.001 0 0 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ** Compaction Stats [default] ** 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 55.5 0.00 0.00 1 0.001 0 0 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Cumulative compaction: 0.00 GB write, 14.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Interval compaction: 0.00 GB write, 14.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T18:37:06.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ** Compaction Stats [default] ** 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: L0 2/0 66.50 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 55.5 0.00 0.00 1 0.001 0 0 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Sum 2/0 66.50 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 55.5 0.00 0.00 1 0.001 0 0 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ** Compaction Stats [default] ** 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 55.5 0.00 0.00 1 0.001 0 0 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T18:37:06.782 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Cumulative compaction: 0.00 GB write, 14.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.491+0000 7fcb95a9e700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] at bind addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.491+0000 7fcb95a9e700 1 mon.a@-1(???) e1 preinit fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.491+0000 7fcb95a9e700 0 mon.a@-1(???).mds e1 new map 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.491+0000 7fcb95a9e700 0 mon.a@-1(???).mds e1 print_map 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: e1 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: legacy client fscid: -1 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: No filesystems configured 2024-02-22T18:37:06.783 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.491+0000 7fcb95a9e700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.491+0000 7fcb95a9e700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.491+0000 7fcb95a9e700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.491+0000 7fcb95a9e700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: audit 2024-02-22T18:37:03.922555+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.40:0/3175124859' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.491+0000 7fcb95a9e700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta expand map: {default=false} 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta from 'false' to 'false' 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta expanded map: {default=false} 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta expand map: {default=info} 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta from 'info' to 'info' 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta expanded map: {default=info} 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta expand map: {default=daemon} 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta from 'daemon' to 'daemon' 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta expanded map: {default=daemon} 2024-02-22T18:37:06.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta expand map: {default=debug} 2024-02-22T18:37:06.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta from 'debug' to 'debug' 2024-02-22T18:37:06.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: debug 2024-02-22T18:37:06.495+0000 7fcb95a9e700 20 expand_channel_meta expanded map: {default=debug} 2024-02-22T18:37:06.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: cluster 2024-02-22T18:37:06.500184+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-22T18:37:06.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: cluster 2024-02-22T18:37:06.500303+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0]} 2024-02-22T18:37:06.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: cluster 2024-02-22T18:37:06.500351+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-02-22T18:37:06.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: cluster 2024-02-22T18:37:06.500387+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-22T18:37:06.785 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:06 smithi040 bash[13988]: cluster 2024-02-22T18:37:06.500920+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-22T18:37:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:Creating mgr... 2024-02-22T18:37:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:Verifying port 9283 ... 2024-02-22T18:37:07.404 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl daemon-reload 2024-02-22T18:37:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y 2024-02-22T18:37:07.600 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl reset-failed ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y 2024-02-22T18:37:07.606 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Failed to reset failed state of unit ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y.service: Unit ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y.service not loaded. 2024-02-22T18:37:07.606 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl enable ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y 2024-02-22T18:37:07.612 INFO:teuthology.orchestra.run.smithi040.stderr:systemctl: stderr Created symlink /etc/systemd/system/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715.target.wants/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y.service -> /etc/systemd/system/ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@.service. 2024-02-22T18:37:07.781 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: systemctl start ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y 2024-02-22T18:37:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:firewalld does not appear to be present 2024-02-22T18:37:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:Not possible to enable service . firewalld.service is not available 2024-02-22T18:37:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:Not possible to open ports <[]>. firewalld.service is not available 2024-02-22T18:37:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:firewalld does not appear to be present 2024-02-22T18:37:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-22T18:37:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-22T18:37:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:Wrote config to /etc/ceph/ceph.conf 2024-02-22T18:37:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:Waiting for mgr to start... 2024-02-22T18:37:07.792 INFO:teuthology.orchestra.run.smithi040.stderr:Waiting for mgr... 2024-02-22T18:37:07.792 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 status -f json-pretty 2024-02-22T18:37:08.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:07 smithi040 bash[13988]: audit 2024-02-22T18:37:06.737549+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.40:0/1531605782' entity='client.admin' 2024-02-22T18:37:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "fsid": "42039b9c-d1b1-11ee-95bf-87774f69a715", 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "health": { 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "checks": {}, 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mutes": [] 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "quorum": [ 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 0 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "a" 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "quorum_age": 2, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "monmap": { 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min_mon_release_name": "octopus", 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_mons": 1 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "osdmap": { 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pgmap": { 2024-02-22T18:37:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "fsmap": { 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "by_rank": [], 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "up:standby": 0 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mgrmap": { 2024-02-22T18:37:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "available": false, 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "modules": [ 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "iostat", 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "restful" 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "services": {} 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "servicemap": { 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "modified": "2024-02-22T18:37:00.495492+0000", 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "services": {} 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "progress_events": {} 2024-02-22T18:37:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:09.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:09 smithi040 bash[13988]: audit 2024-02-22T18:37:09.378795+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.40:0/2493778482' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-22T18:37:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:mgr not available, waiting (1/10)... 2024-02-22T18:37:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 status -f json-pretty 2024-02-22T18:37:12.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:12.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:12.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "fsid": "42039b9c-d1b1-11ee-95bf-87774f69a715", 2024-02-22T18:37:12.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "health": { 2024-02-22T18:37:12.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-22T18:37:12.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "checks": {}, 2024-02-22T18:37:12.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mutes": [] 2024-02-22T18:37:12.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "quorum": [ 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 0 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "a" 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "quorum_age": 5, 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "monmap": { 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min_mon_release_name": "octopus", 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_mons": 1 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "osdmap": { 2024-02-22T18:37:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-22T18:37:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-22T18:37:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-22T18:37:12.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-22T18:37:12.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-22T18:37:12.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-22T18:37:12.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:12.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pgmap": { 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "fsmap": { 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "by_rank": [], 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "up:standby": 0 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mgrmap": { 2024-02-22T18:37:12.067 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "available": false, 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "modules": [ 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "iostat", 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "restful" 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "services": {} 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "servicemap": { 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "modified": "2024-02-22T18:37:00.495492+0000", 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "services": {} 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "progress_events": {} 2024-02-22T18:37:12.068 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:12.631 INFO:teuthology.orchestra.run.smithi040.stderr:mgr not available, waiting (2/10)... 2024-02-22T18:37:12.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:12 smithi040 bash[13988]: audit 2024-02-22T18:37:12.057141+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.40:0/587130927' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-22T18:37:13.633 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 status -f json-pretty 2024-02-22T18:37:13.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: cluster 2024-02-22T18:37:13.622390+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2024-02-22T18:37:13.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: cluster 2024-02-22T18:37:13.626902+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00470099s) 2024-02-22T18:37:13.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: audit 2024-02-22T18:37:13.629558+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T18:37:13.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: audit 2024-02-22T18:37:13.629892+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T18:37:13.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: audit 2024-02-22T18:37:13.630260+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T18:37:13.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: audit 2024-02-22T18:37:13.631355+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T18:37:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: audit 2024-02-22T18:37:13.631965+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T18:37:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: cluster 2024-02-22T18:37:13.637810+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2024-02-22T18:37:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: audit 2024-02-22T18:37:13.653764+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' 2024-02-22T18:37:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: audit 2024-02-22T18:37:13.660025+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:37:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: audit 2024-02-22T18:37:13.661623+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:37:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:13 smithi040 bash[13988]: audit 2024-02-22T18:37:13.670025+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' 2024-02-22T18:37:14.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:14 smithi040 bash[13988]: audit 2024-02-22T18:37:13.675327+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.40:0/1737696804' entity='mgr.y' 2024-02-22T18:37:14.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:14 smithi040 bash[13988]: cluster 2024-02-22T18:37:14.634922+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01271s) 2024-02-22T18:37:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 2024-02-22T18:37:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "fsid": "42039b9c-d1b1-11ee-95bf-87774f69a715", 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "health": { 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "checks": {}, 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mutes": [] 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "quorum": [ 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 0 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-22T18:37:15.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "a" 2024-02-22T18:37:15.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:15.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "quorum_age": 8, 2024-02-22T18:37:15.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "monmap": { 2024-02-22T18:37:15.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:15.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min_mon_release_name": "octopus", 2024-02-22T18:37:15.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_mons": 1 2024-02-22T18:37:15.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:15.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "osdmap": { 2024-02-22T18:37:15.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:15.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-22T18:37:15.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-22T18:37:15.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-22T18:37:15.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-22T18:37:15.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-22T18:37:15.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-22T18:37:15.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pgmap": { 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:15.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "fsmap": { 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "by_rank": [], 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "up:standby": 0 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mgrmap": { 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "available": true, 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "modules": [ 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "iostat", 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "restful" 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "services": {} 2024-02-22T18:37:15.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:15.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "servicemap": { 2024-02-22T18:37:15.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 1, 2024-02-22T18:37:15.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "modified": "2024-02-22T18:37:00.495492+0000", 2024-02-22T18:37:15.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "services": {} 2024-02-22T18:37:15.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:15.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "progress_events": {} 2024-02-22T18:37:15.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:mgr is available 2024-02-22T18:37:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 config-key set mgr/cephadm/ssh_user root 2024-02-22T18:37:15.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:15 smithi040 bash[13988]: audit 2024-02-22T18:37:15.016256+0000 mon.a (mon.0) 23 : audit [DBG] from='client.? 172.21.15.40:0/2099249143' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-22T18:37:16.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stderr set mgr/cephadm/ssh_user 2024-02-22T18:37:16.996 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:16 smithi040 bash[13988]: cluster 2024-02-22T18:37:15.689967+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-02-22T18:37:17.609 INFO:teuthology.orchestra.run.smithi040.stderr:Enabling cephadm module... 2024-02-22T18:37:17.610 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 mgr module enable cephadm 2024-02-22T18:37:18.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:17 smithi040 bash[13988]: audit 2024-02-22T18:37:16.966886+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.40:0/914046496' entity='client.admin' 2024-02-22T18:37:19.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:18 smithi040 bash[13988]: audit 2024-02-22T18:37:18.807690+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.40:0/1089758072' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-22T18:37:19.427 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:19 smithi040 bash[14251]: ignoring --setgroup ceph since I am not root 2024-02-22T18:37:19.548 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 mgr dump 2024-02-22T18:37:20.276 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:19 smithi040 bash[13988]: audit 2024-02-22T18:37:18.976493+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.40:0/1089758072' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-22T18:37:20.276 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:19 smithi040 bash[13988]: cluster 2024-02-22T18:37:18.976670+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 5s) 2024-02-22T18:37:20.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:20.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 5, 2024-02-22T18:37:20.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_gid": 14100, 2024-02-22T18:37:20.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_name": "y", 2024-02-22T18:37:20.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_addrs": { 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addrvec": [ 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "v2", 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addr": "172.21.15.40:6800", 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nonce": 4078705069 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "v1", 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addr": "172.21.15.40:6801", 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nonce": 4078705069 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ] 2024-02-22T18:37:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_addr": "172.21.15.40:6801/4078705069", 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_change": "2024-02-22T18:37:13.622182+0000", 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_mgr_features": 4540138292840890367, 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "available": true, 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "standbys": [], 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "modules": [ 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "cephadm", 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "iostat", 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "restful" 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "available_modules": [ 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "alerts", 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:20.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "How frequently to reexamine health status", 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_destination": { 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_destination", 2024-02-22T18:37:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Email address to send alerts to", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_from_name": { 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_from_name", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "Ceph", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Email From: name", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_host": { 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_host", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "SMTP server", 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_password": { 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_password", 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.160 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Password to authenticate with", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_port": { 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_port", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "465", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "SMTP port", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_sender": { 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_sender", 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "SMTP envelope sender", 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_ssl": { 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_ssl", 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Use SSL to connect to SMTP server", 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_user": { 2024-02-22T18:37:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_user", 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "User to authenticate as", 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "balancer", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active": { 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "active", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "automatically balance PGs across cluster", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.165 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "begin_time": { 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "begin_time", 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0000", 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "beginning time of day to automatically balance", 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "begin_weekday": { 2024-02-22T18:37:21.166 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "begin_weekday", 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "uint", 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0", 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "0", 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "7", 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crush_compat_max_iterations": { 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crush_compat_max_iterations", 2024-02-22T18:37:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "uint", 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "25", 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "1", 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "250", 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "maximum number of iterations to attempt optimization", 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crush_compat_metrics": { 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crush_compat_metrics", 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "pgs,objects,bytes", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "metrics with which to calculate OSD utilization", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crush_compat_step": { 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crush_compat_step", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "float", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0.5", 2024-02-22T18:37:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "0.001", 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "0.999", 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "aggressiveness of optimization", 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "end_time": { 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "end_time", 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "2400", 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "ending time of day to automatically balance", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "end_weekday": { 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "end_weekday", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "uint", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "7", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "0", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "7", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-22T18:37:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min_score": { 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "min_score", 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "float", 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0", 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "minimum score, below which no optimization is attempted", 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mode": { 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "mode", 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "none", 2024-02-22T18:37:21.177 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crush-compat", 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "none", 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "upmap" 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Balancer mode", 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pool_ids": { 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "pool_ids", 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "pools which the automatic balancing will be limited to", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "sleep_interval": { 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "sleep_interval", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to wake up and attempt optimization", 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "upmap_max_deviation": { 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "upmap_max_deviation", 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5", 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "1", 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "deviation below which no optimization is attempted", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "upmap_max_optimizations": { 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "upmap_max_optimizations", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "uint", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "maximum upmap optimizations to make per attempt", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "cephadm", 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "allow_ptrace": { 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "allow_ptrace", 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "config_dashboard": { 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "config_dashboard", 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "manage configs like API endpoints in Dashboard.", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_alertmanager": { 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_alertmanager", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/prom/alertmanager:v0.20.0", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Prometheus container image", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_base": { 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_base", 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/ceph/ceph", 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Container image name, without the tag", 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_grafana": { 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_grafana", 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/ceph/ceph-grafana:6.6.2", 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Prometheus container image", 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_node_exporter": { 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_node_exporter", 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/prom/node-exporter:v0.18.1", 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Prometheus container image", 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_prometheus": { 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_prometheus", 2024-02-22T18:37:21.187 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/prom/prometheus:v2.18.1", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Prometheus container image", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_init": { 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_init", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.188 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Run podman/docker with `--init`", 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "daemon_cache_timeout": { 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "daemon_cache_timeout", 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "600", 2024-02-22T18:37:21.189 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "seconds to cache service (daemon) inventory", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "device_cache_timeout": { 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "device_cache_timeout", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "1800", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.190 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "seconds to cache device inventory", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "facts_cache_timeout": { 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "facts_cache_timeout", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "seconds to cache host facts data", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.191 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "host_check_interval": { 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "host_check_interval", 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "600", 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to perform a host check", 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.192 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.195 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "manage_etc_ceph_ceph_conf": { 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "manage_etc_ceph_ceph_conf", 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-22T18:37:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "migration_current": { 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "migration_current", 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "internal - do not modify", 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mode": { 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "mode", 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "root", 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "cephadm-package", 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "root" 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "mode for remote execution of cephadm", 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.199 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "prometheus_alerts_path": { 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "prometheus_alerts_path", 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "location of alerts to include in prometheus deployments", 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "registry_password": { 2024-02-22T18:37:21.200 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "registry_password", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Custom repository password", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "registry_url": { 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "registry_url", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.201 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Custom repository url", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "registry_username": { 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "registry_username", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.202 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Custom repository username", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ssh_config_file": { 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ssh_config_file", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "customized SSH config file to connect to managed hosts", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "use_repo_digest": { 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "use_repo_digest", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.204 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_on_failed_host_check": { 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_on_failed_host_check", 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "raise a health warning if the host check fails", 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.205 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_on_stray_daemons": { 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_on_stray_daemons", 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_on_stray_hosts": { 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_on_stray_hosts", 2024-02-22T18:37:21.206 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.207 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crash", 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.209 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.210 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.211 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "retain_interval": { 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "retain_interval", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.212 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "31536000", 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how long to retain crashes before pruning them", 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_recent_interval": { 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_recent_interval", 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.213 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "1209600", 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "time interval in which to warn about recent crashes", 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "dashboard", 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-22T18:37:21.214 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ALERTMANAGER_API_HOST": { 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ALERTMANAGER_API_HOST", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.215 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "AUDIT_API_ENABLED": { 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "AUDIT_API_ENABLED", 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "AUDIT_API_LOG_PAYLOAD": { 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ENABLE_BROWSABLE_API": { 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ENABLE_BROWSABLE_API", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_cephfs": { 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_cephfs", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_iscsi": { 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_iscsi", 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_mirroring": { 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_mirroring", 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_nfs": { 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_nfs", 2024-02-22T18:37:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_rbd": { 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_rbd", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_rgw": { 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_rgw", 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_API_PASSWORD": { 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_API_PASSWORD", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "admin", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_API_SSL_VERIFY": { 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_API_URL": { 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_API_URL", 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_API_USERNAME": { 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_API_USERNAME", 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "admin", 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_FRONTEND_API_URL": { 2024-02-22T18:37:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_FRONTEND_API_URL", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ISCSI_API_SSL_VERIFICATION": { 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PROMETHEUS_API_HOST": { 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PROMETHEUS_API_HOST", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.236 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.237 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_ENABLED": { 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_ENABLED", 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.238 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.239 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.240 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_MIN_LENGTH": { 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "8", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "REST_REQUESTS_TIMEOUT": { 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "REST_REQUESTS_TIMEOUT", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.241 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "45", 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_ACCESS_KEY": { 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_ACCESS_KEY", 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.242 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_ADMIN_RESOURCE": { 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "admin", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.243 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_HOST": { 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_HOST", 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.244 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_PORT": { 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_PORT", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "80", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.245 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_SCHEME": { 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_SCHEME", 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "http", 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.246 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_SECRET_KEY": { 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_SECRET_KEY", 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_SSL_VERIFY": { 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_SSL_VERIFY", 2024-02-22T18:37:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_USER_ID": { 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_USER_ID", 2024-02-22T18:37:21.248 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "USER_PWD_EXPIRATION_SPAN": { 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crt_file": { 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crt_file", 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug": { 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "debug", 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Enable/disable debug options", 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "jwt_token_ttl": { 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "jwt_token_ttl", 2024-02-22T18:37:21.253 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "28800", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "key_file": { 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "key_file", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.259 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "password": { 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "password", 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_addr": { 2024-02-22T18:37:21.260 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_addr", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "::", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_port": { 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_port", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.261 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "8080", 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ssl": { 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ssl", 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.262 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ssl_server_port": { 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ssl_server_port", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "8443", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.263 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "standby_behaviour": { 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "standby_behaviour", 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "redirect", 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.264 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "redirect" 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "standby_error_status_code": { 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "standby_error_status_code", 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "500", 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "400", 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "599", 2024-02-22T18:37:21.265 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "url_prefix": { 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "url_prefix", 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "username": { 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "username", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.267 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "devicehealth", 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enable_monitoring": { 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "enable_monitoring", 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.268 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "monitor device health metrics", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.269 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.270 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.271 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mark_out_threshold": { 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "mark_out_threshold", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.273 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "2419200", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "automatically mark OSD if it may fail before this long", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pool_name": { 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "pool_name", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "device_health_metrics", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.274 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "name of pool in which to store device health metrics", 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "retention_period": { 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "retention_period", 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "15552000", 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how long to retain device health metrics", 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "scrape_frequency": { 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "scrape_frequency", 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "86400", 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.276 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to scrape device health metrics", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "self_heal": { 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "self_heal", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "preemptively heal cluster around devices that may fail", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.277 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "sleep_interval": { 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "sleep_interval", 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "600", 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to wake up and check device health", 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.278 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_threshold": { 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_threshold", 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "7257600", 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "raise health warning if OSD may fail before this long", 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.279 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "diskprediction_local", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.280 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.281 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.282 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.283 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "predict_interval": { 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "predict_interval", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "86400", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.284 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "predictor_model": { 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "predictor_model", 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "prophetstor", 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.285 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "sleep_interval": { 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "sleep_interval", 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "600", 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.286 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "influx", 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": false, 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "influxdb python module not found", 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "batch_size": { 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "batch_size", 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5000", 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.287 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "database": { 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "database", 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "ceph", 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.288 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "hostname": { 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "hostname", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.289 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "30", 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.290 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.292 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "password": { 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "password", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.295 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "port": { 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "port", 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "8086", 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.296 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ssl": { 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ssl", 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "false", 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.297 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "threads": { 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "threads", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "username": { 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "username", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.298 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "verify_ssl": { 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "verify_ssl", 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.299 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "true", 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "insights", 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.300 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.303 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "iostat", 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.308 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "k8sevents", 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ceph_event_retention_days": { 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ceph_event_retention_days", 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "7", 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Days to hold ceph event information within local cache", 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "config_check_secs": { 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "config_check_secs", 2024-02-22T18:37:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "10", 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.316 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "localpool", 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "failure_domain": { 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "failure_domain", 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.317 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "host", 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "failure domain for any created local pool", 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.318 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min_size": { 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "min_size", 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "default min_size for any created local pool", 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_rep": { 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "num_rep", 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "3", 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "default replica count for any created local pool", 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.324 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pg_num": { 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "pg_num", 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "128", 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "default pg_num for any created local pool", 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.325 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "prefix": { 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "prefix", 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "name prefix for any created local pool", 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "subtree": { 2024-02-22T18:37:21.326 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "subtree", 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "rack", 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "CRUSH level for which to create a local pool", 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "orchestrator", 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.328 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.329 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.330 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.331 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "orchestrator": { 2024-02-22T18:37:21.332 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "orchestrator", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "cephadm", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rook", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "test_orchestrator" 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Orchestrator backend", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.333 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "osd_support", 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.334 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.335 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.336 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.337 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.338 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "pg_autoscaler", 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.339 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.340 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.341 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.342 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.343 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "sleep_interval": { 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "sleep_interval", 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "progress", 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enabled": { 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "enabled", 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max_completed_events": { 2024-02-22T18:37:21.350 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "max_completed_events", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "50", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "number of past completed events to remember", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "persist_interval": { 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "persist_interval", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5", 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to persist completed events", 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "prometheus", 2024-02-22T18:37:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rbd_stats_pools": { 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rbd_stats_pools", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rbd_stats_pools_refresh_interval": { 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rbd_stats_pools_refresh_interval", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "300", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "scrape_interval": { 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "scrape_interval", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_addr": { 2024-02-22T18:37:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_addr", 2024-02-22T18:37:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_port": { 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_port", 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "stale_cache_strategy": { 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "stale_cache_strategy", 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rbd_support", 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.363 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.364 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.366 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.367 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mirror_snapshot_schedule": { 2024-02-22T18:37:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "mirror_snapshot_schedule", 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "trash_purge_schedule": { 2024-02-22T18:37:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "trash_purge_schedule", 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.370 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "restful", 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "key_file": { 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "key_file", 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.371 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.372 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.373 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.374 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.375 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.376 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_addr": { 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_addr", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.377 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_port": { 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_port", 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.378 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rook", 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.379 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.380 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.381 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.382 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.383 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "selftest", 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.384 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.385 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.386 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.387 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.388 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "roption1": { 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "roption1", 2024-02-22T18:37:21.389 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "roption2": { 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "roption2", 2024-02-22T18:37:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "xyz", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption1": { 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption1", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption2": { 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption2", 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption3": { 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption3", 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "float", 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption4": { 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption4", 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption5": { 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption5", 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption6": { 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption6", 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "testkey": { 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "testkey", 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "testlkey": { 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "testlkey", 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "testnewline": { 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "testnewline", 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "status", 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.402 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "telegraf", 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "address": { 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "address", 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "15", 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.410 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "telemetry", 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "channel_basic": { 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "channel_basic", 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Share basic cluster information (size, version)", 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "channel_crash": { 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "channel_crash", 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "channel_device": { 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "channel_device", 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "channel_ident": { 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "channel_ident", 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.416 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "contact": { 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "contact", 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.417 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "description": { 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "description", 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.418 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "device_url": { 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "device_url", 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "https://telemetry.ceph.com/device", 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.419 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enabled": { 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "enabled", 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.420 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "24", 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "8", 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.421 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "last_opt_revision": { 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "last_opt_revision", 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "1", 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.422 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "leaderboard": { 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "leaderboard", 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.423 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.424 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.425 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.426 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.427 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.428 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "organization": { 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "organization", 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.429 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "proxy": { 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "proxy", 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.430 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "url": { 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "url", 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "https://telemetry.ceph.com/report", 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.431 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "test_orchestrator", 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.432 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.434 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "volumes", 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max_concurrent_clones": { 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "max_concurrent_clones", 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "4", 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Number of asynchronous cloner threads", 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "zabbix", 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "discovery_interval": { 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "discovery_interval", 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "100", 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "identifier": { 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "identifier", 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "zabbix_host": { 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "zabbix_host", 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "zabbix_port": { 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "zabbix_port", 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10051", 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "zabbix_sender": { 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "zabbix_sender", 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "/usr/bin/zabbix_sender", 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "services": {}, 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "always_on_modules": { 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nautilus": [ 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "balancer", 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crash", 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "devicehealth", 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "orchestrator_cli", 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "progress", 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rbd_support", 2024-02-22T18:37:21.454 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "status", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "volumes" 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "octopus": [ 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "balancer", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crash", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "devicehealth", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "orchestrator", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pg_autoscaler", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "progress", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rbd_support", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "status", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "telemetry", 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "volumes" 2024-02-22T18:37:21.455 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "last_failure_osd_epoch": 0, 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_clients": [ 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addrvec": [ 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "v2", 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addr": "172.21.15.40:0", 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nonce": 3335014977 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ] 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addrvec": [ 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:21.456 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "v2", 2024-02-22T18:37:21.457 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addr": "172.21.15.40:0", 2024-02-22T18:37:21.457 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nonce": 3097014655 2024-02-22T18:37:21.457 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.457 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ] 2024-02-22T18:37:21.457 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.457 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ] 2024-02-22T18:37:21.457 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.457 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:21.458 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:20 smithi040 bash[13988]: audit 2024-02-22T18:37:20.751725+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.40:0/4127147596' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-02-22T18:37:21.472 INFO:teuthology.orchestra.run.smithi040.stderr:Waiting for the mgr to restart... 2024-02-22T18:37:21.472 INFO:teuthology.orchestra.run.smithi040.stderr:Waiting for Mgr epoch 5... 2024-02-22T18:37:21.472 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 tell mgr mgr_status 2024-02-22T18:37:24.578 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:24.579 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-22T18:37:24.579 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "initialized": true 2024-02-22T18:37:24.579 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:24.797 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: cluster 2024-02-22T18:37:23.497945+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2024-02-22T18:37:24.797 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: cluster 2024-02-22T18:37:23.498705+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2024-02-22T18:37:24.797 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: cluster 2024-02-22T18:37:23.504066+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-22T18:37:24.797 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: cluster 2024-02-22T18:37:23.552679+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0541274s) 2024-02-22T18:37:24.797 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.557220+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T18:37:24.797 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.558744+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T18:37:24.797 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.559229+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T18:37:24.797 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.559657+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.560495+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.561930+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.562656+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.563301+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.563772+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: cluster 2024-02-22T18:37:23.567964+0000 mon.a (mon.0) 43 : cluster [INF] Manager daemon y is now available 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.593786+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.601096+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.609654+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.748358+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.754145+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.769304+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:37:24.798 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:24 smithi040 bash[13988]: audit 2024-02-22T18:37:23.771998+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:37:25.229 INFO:teuthology.orchestra.run.smithi040.stderr:Mgr epoch 5 is available 2024-02-22T18:37:25.230 INFO:teuthology.orchestra.run.smithi040.stderr:Setting orchestrator backend to cephadm... 2024-02-22T18:37:25.230 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 orch set backend cephadm 2024-02-22T18:37:25.893 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:25 smithi040 bash[13988]: cluster 2024-02-22T18:37:24.555167+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.05662s) 2024-02-22T18:37:25.894 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:25 smithi040 bash[13988]: audit 2024-02-22T18:37:24.556623+0000 mgr.y (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-22T18:37:25.894 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:25 smithi040 bash[13988]: audit 2024-02-22T18:37:24.576509+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-22T18:37:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:26 smithi040 bash[13988]: cluster 2024-02-22T18:37:25.557797+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-02-22T18:37:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:26 smithi040 bash[13988]: audit 2024-02-22T18:37:26.425680+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:26 smithi040 bash[13988]: audit 2024-02-22T18:37:26.436338+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:Generating ssh key... 2024-02-22T18:37:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 cephadm generate-key 2024-02-22T18:37:27.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:27 smithi040 bash[13988]: audit 2024-02-22T18:37:26.418011+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:37:28.927 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: Generating public/private rsa key pair. 2024-02-22T18:37:28.927 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: Your identification has been saved in /tmp/tmp3knw74ck/key. 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: Your public key has been saved in /tmp/tmp3knw74ck/key.pub. 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: The key fingerprint is: 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: SHA256:eqdYpcbVrOOXjdejKmbYghVJ97d+gt7uFhYiCTGq8Pg ceph-42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: The key's randomart image is: 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: +---[RSA 3072]----+ 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: | o. | 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: | .o.. | 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: | . .. + o | 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: | + . o o = o | 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: | . o S + = o | 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: | . + + . + | 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: | E + O + ++.. | 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: | . B O o=+oo.| 2024-02-22T18:37:28.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: | . = ++=*+ .| 2024-02-22T18:37:28.929 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:28 smithi040 bash[14251]: +----[SHA256]-----+ 2024-02-22T18:37:29.082 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 cephadm get-pub-key 2024-02-22T18:37:29.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:29 smithi040 bash[13988]: audit 2024-02-22T18:37:28.175994+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:37:29.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:29 smithi040 bash[13988]: cephadm 2024-02-22T18:37:28.176431+0000 mgr.y (mgr.14116) 5 : cephadm [INF] Generating ssh key... 2024-02-22T18:37:29.774 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:29 smithi040 bash[13988]: audit 2024-02-22T18:37:28.483740+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:29.775 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:29 smithi040 bash[13988]: audit 2024-02-22T18:37:28.486482+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:30.208 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXvJzlUF+KUvfmYcqcq8VPyLHLR2SWRhc5l3bDd7SuneU9ZJE7EDoOe499YG8mOIwNZ2xAcgC2ZbZL7SzQmK4qvrWvk2OZ0V90zP+Vhsz+ciN/miThu4i9M46O1ejMXs71tD2SxMsemVJ/lXJAxa+WiV0k6rLzhzpBX7wLIHyydw2tPR3dlUtRFurjGkaenr4ufi7JBRQrxN11bBf43yOkbaQioUFN2rAXYWUjgFIwtDv7Qqv9LhyLn8uexIUawj5ivuLzAFpTE4W/PDQFbAqbhwow0E8qca1mNSjby/xwgA/NqQwHX9qN4nUaXqWnxAOwEMM6xaWivOlGDlv1SdGGA/JCJbJbfuiqdJYtNy/w+tZ8mMphmR7AK04oXIg/izs7tIwUsv/Wk1cXZm/6sb8CHIedX0s137fXnD0WPOZnS33jFhw7jpWeXSKFKaDB1D+MwA3OlyJ29XHB9McN11+QxgTUzt1LJ/0Z/mViVSVDDqjW56fs0bHCvQCMqSt+pnE= ceph-42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:37:30.804 INFO:teuthology.orchestra.run.smithi040.stderr:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2024-02-22T18:37:30.805 INFO:teuthology.orchestra.run.smithi040.stderr:Adding key to root@localhost's authorized_keys... 2024-02-22T18:37:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:Adding host smithi040... 2024-02-22T18:37:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 orch host add smithi040 2024-02-22T18:37:31.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:31 smithi040 bash[13988]: audit 2024-02-22T18:37:30.206390+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:37:32.427 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:32 smithi040 bash[14251]: Warning: Permanently added 'smithi040,172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-22T18:37:32.727 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout Added host 'smithi040' 2024-02-22T18:37:32.773 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:32 smithi040 bash[13988]: audit 2024-02-22T18:37:31.987228+0000 mgr.y (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi040", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:37:33.425 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 config set mgr mgr/dashboard/ssl_server_port 8443 2024-02-22T18:37:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:33 smithi040 bash[13988]: audit 2024-02-22T18:37:32.722731+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:33 smithi040 bash[13988]: cephadm 2024-02-22T18:37:32.723490+0000 mgr.y (mgr.14116) 8 : cephadm [INF] Added host smithi040 2024-02-22T18:37:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:33 smithi040 bash[13988]: audit 2024-02-22T18:37:33.086415+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:33 smithi040 bash[13988]: audit 2024-02-22T18:37:33.087830+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:37:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:33 smithi040 bash[13988]: audit 2024-02-22T18:37:33.621923+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' 2024-02-22T18:37:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:33 smithi040 bash[13988]: audit 2024-02-22T18:37:33.622922+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14116 172.21.15.40:0/2205294369' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:37:35.949 INFO:teuthology.orchestra.run.smithi040.stderr:Enabling the dashboard module... 2024-02-22T18:37:35.949 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 mgr module enable dashboard 2024-02-22T18:37:36.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:36 smithi040 bash[13988]: audit 2024-02-22T18:37:35.009959+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.40:0/1400229143' entity='client.admin' 2024-02-22T18:37:37.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:37 smithi040 bash[13988]: audit 2024-02-22T18:37:37.185676+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.40:0/2094475779' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-22T18:37:37.927 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:37 smithi040 bash[14251]: ignoring --setuser ceph since I am not root 2024-02-22T18:37:37.927 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:37 smithi040 bash[14251]: ignoring --setgroup ceph since I am not root 2024-02-22T18:37:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 mgr dump 2024-02-22T18:37:38.820 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:38 smithi040 bash[13988]: audit 2024-02-22T18:37:37.516399+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.15.40:0/2094475779' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-22T18:37:38.820 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:38 smithi040 bash[13988]: cluster 2024-02-22T18:37:37.516528+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e9: y(active, since 14s) 2024-02-22T18:37:39.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.310 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "epoch": 9, 2024-02-22T18:37:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_gid": 14116, 2024-02-22T18:37:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_name": "y", 2024-02-22T18:37:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_addrs": { 2024-02-22T18:37:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addrvec": [ 2024-02-22T18:37:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "v2", 2024-02-22T18:37:39.311 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addr": "172.21.15.40:6800", 2024-02-22T18:37:39.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nonce": 2234583781 2024-02-22T18:37:39.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.312 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "v1", 2024-02-22T18:37:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addr": "172.21.15.40:6801", 2024-02-22T18:37:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nonce": 2234583781 2024-02-22T18:37:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ] 2024-02-22T18:37:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_addr": "172.21.15.40:6801/2234583781", 2024-02-22T18:37:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_change": "2024-02-22T18:37:23.498535+0000", 2024-02-22T18:37:39.739 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_mgr_features": 4540138292840890367, 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "available": true, 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "standbys": [], 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "modules": [ 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "cephadm", 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "dashboard", 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "iostat", 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "restful" 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "available_modules": [ 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "alerts", 2024-02-22T18:37:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "How frequently to reexamine health status", 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_destination": { 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_destination", 2024-02-22T18:37:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Email address to send alerts to", 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_from_name": { 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_from_name", 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "Ceph", 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Email From: name", 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_host": { 2024-02-22T18:37:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_host", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "SMTP server", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_password": { 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_password", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Password to authenticate with", 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_port": { 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_port", 2024-02-22T18:37:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "465", 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "SMTP port", 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_sender": { 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_sender", 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "SMTP envelope sender", 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_ssl": { 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_ssl", 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Use SSL to connect to SMTP server", 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "smtp_user": { 2024-02-22T18:37:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "smtp_user", 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "User to authenticate as", 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "balancer", 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active": { 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "active", 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.755 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "automatically balance PGs across cluster", 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "begin_time": { 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "begin_time", 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0000", 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "beginning time of day to automatically balance", 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "begin_weekday": { 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "begin_weekday", 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "uint", 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.757 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0", 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "0", 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "7", 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crush_compat_max_iterations": { 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crush_compat_max_iterations", 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "uint", 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "25", 2024-02-22T18:37:39.758 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "1", 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "250", 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "maximum number of iterations to attempt optimization", 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crush_compat_metrics": { 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crush_compat_metrics", 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "pgs,objects,bytes", 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.759 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "metrics with which to calculate OSD utilization", 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crush_compat_step": { 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crush_compat_step", 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "float", 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0.5", 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "0.001", 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "0.999", 2024-02-22T18:37:39.760 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "aggressiveness of optimization", 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "end_time": { 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "end_time", 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "2400", 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "ending time of day to automatically balance", 2024-02-22T18:37:39.761 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "end_weekday": { 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "end_weekday", 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "uint", 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "7", 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "0", 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "7", 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-22T18:37:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.767 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min_score": { 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "min_score", 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "float", 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0", 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "minimum score, below which no optimization is attempted", 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.768 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mode": { 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "mode", 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "none", 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crush-compat", 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "none", 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "upmap" 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Balancer mode", 2024-02-22T18:37:39.769 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pool_ids": { 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "pool_ids", 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "pools which the automatic balancing will be limited to", 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.770 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "sleep_interval": { 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "sleep_interval", 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to wake up and attempt optimization", 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "upmap_max_deviation": { 2024-02-22T18:37:39.771 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "upmap_max_deviation", 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5", 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "1", 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "deviation below which no optimization is attempted", 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.772 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "upmap_max_optimizations": { 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "upmap_max_optimizations", 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "uint", 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "maximum upmap optimizations to make per attempt", 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "cephadm", 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "allow_ptrace": { 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "allow_ptrace", 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.774 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "config_dashboard": { 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "config_dashboard", 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "manage configs like API endpoints in Dashboard.", 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_alertmanager": { 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_alertmanager", 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/prom/alertmanager:v0.20.0", 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Prometheus container image", 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_base": { 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_base", 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/ceph/ceph", 2024-02-22T18:37:39.777 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Container image name, without the tag", 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_grafana": { 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_grafana", 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.778 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/ceph/ceph-grafana:6.6.2", 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Prometheus container image", 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_node_exporter": { 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_node_exporter", 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.779 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/prom/node-exporter:v0.18.1", 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Prometheus container image", 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_image_prometheus": { 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_image_prometheus", 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "docker.io/prom/prometheus:v2.18.1", 2024-02-22T18:37:39.780 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Prometheus container image", 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "container_init": { 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "container_init", 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.781 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Run podman/docker with `--init`", 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "daemon_cache_timeout": { 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "daemon_cache_timeout", 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "600", 2024-02-22T18:37:39.782 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "seconds to cache service (daemon) inventory", 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "device_cache_timeout": { 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "device_cache_timeout", 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "1800", 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.783 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "seconds to cache device inventory", 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "facts_cache_timeout": { 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "facts_cache_timeout", 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:39.784 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "seconds to cache host facts data", 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "host_check_interval": { 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "host_check_interval", 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "600", 2024-02-22T18:37:39.785 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to perform a host check", 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "manage_etc_ceph_ceph_conf": { 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "manage_etc_ceph_ceph_conf", 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.791 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "migration_current": { 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "migration_current", 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "internal - do not modify", 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mode": { 2024-02-22T18:37:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "mode", 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "root", 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "cephadm-package", 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "root" 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "mode for remote execution of cephadm", 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "prometheus_alerts_path": { 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "prometheus_alerts_path", 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "location of alerts to include in prometheus deployments", 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "registry_password": { 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "registry_password", 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Custom repository password", 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "registry_url": { 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "registry_url", 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Custom repository url", 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "registry_username": { 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "registry_username", 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Custom repository username", 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ssh_config_file": { 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ssh_config_file", 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "customized SSH config file to connect to managed hosts", 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "use_repo_digest": { 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "use_repo_digest", 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_on_failed_host_check": { 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_on_failed_host_check", 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "raise a health warning if the host check fails", 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_on_stray_daemons": { 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_on_stray_daemons", 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_on_stray_hosts": { 2024-02-22T18:37:39.801 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_on_stray_hosts", 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.802 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crash", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.803 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.804 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.805 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.806 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.807 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "retain_interval": { 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "retain_interval", 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "31536000", 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how long to retain crashes before pruning them", 2024-02-22T18:37:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_recent_interval": { 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_recent_interval", 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "1209600", 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "time interval in which to warn about recent crashes", 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "dashboard", 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ALERTMANAGER_API_HOST": { 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ALERTMANAGER_API_HOST", 2024-02-22T18:37:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "AUDIT_API_ENABLED": { 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "AUDIT_API_ENABLED", 2024-02-22T18:37:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "AUDIT_API_LOG_PAYLOAD": { 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ENABLE_BROWSABLE_API": { 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ENABLE_BROWSABLE_API", 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_cephfs": { 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_cephfs", 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_iscsi": { 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_iscsi", 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.816 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_mirroring": { 2024-02-22T18:37:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_mirroring", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_nfs": { 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_nfs", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.818 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_rbd": { 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_rbd", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "FEATURE_TOGGLE_rgw": { 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "FEATURE_TOGGLE_rgw", 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_API_PASSWORD": { 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_API_PASSWORD", 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "admin", 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_API_SSL_VERIFY": { 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_API_URL": { 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_API_URL", 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_API_USERNAME": { 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_API_USERNAME", 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "admin", 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_FRONTEND_API_URL": { 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_FRONTEND_API_URL", 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.826 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ISCSI_API_SSL_VERIFICATION": { 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PROMETHEUS_API_HOST": { 2024-02-22T18:37:39.828 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PROMETHEUS_API_HOST", 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-22T18:37:39.829 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.832 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_ENABLED": { 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_ENABLED", 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "PWD_POLICY_MIN_LENGTH": { 2024-02-22T18:37:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "8", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "REST_REQUESTS_TIMEOUT": { 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "REST_REQUESTS_TIMEOUT", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "45", 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_ACCESS_KEY": { 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_ACCESS_KEY", 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_ADMIN_RESOURCE": { 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "admin", 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_HOST": { 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_HOST", 2024-02-22T18:37:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_PORT": { 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_PORT", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.843 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "80", 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_SCHEME": { 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_SCHEME", 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "http", 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_SECRET_KEY": { 2024-02-22T18:37:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_SECRET_KEY", 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_SSL_VERIFY": { 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_SSL_VERIFY", 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "RGW_API_USER_ID": { 2024-02-22T18:37:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "RGW_API_USER_ID", 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "USER_PWD_EXPIRATION_SPAN": { 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "0", 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-22T18:37:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.850 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5", 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crt_file": { 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "crt_file", 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug": { 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "debug", 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Enable/disable debug options", 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "jwt_token_ttl": { 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "jwt_token_ttl", 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "28800", 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "key_file": { 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "key_file", 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "password": { 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "password", 2024-02-22T18:37:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_addr": { 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_addr", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "::", 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_port": { 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_port", 2024-02-22T18:37:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "8080", 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ssl": { 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ssl", 2024-02-22T18:37:39.863 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ssl_server_port": { 2024-02-22T18:37:39.864 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ssl_server_port", 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "8443", 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "standby_behaviour": { 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "standby_behaviour", 2024-02-22T18:37:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "redirect", 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "redirect" 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.866 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "standby_error_status_code": { 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "standby_error_status_code", 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "500", 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "400", 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "599", 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.867 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "url_prefix": { 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "url_prefix", 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.868 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "username": { 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "username", 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "devicehealth", 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enable_monitoring": { 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "enable_monitoring", 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "monitor device health metrics", 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.871 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.874 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mark_out_threshold": { 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "mark_out_threshold", 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "2419200", 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.876 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "automatically mark OSD if it may fail before this long", 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pool_name": { 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "pool_name", 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "device_health_metrics", 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "name of pool in which to store device health metrics", 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "retention_period": { 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "retention_period", 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "15552000", 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how long to retain device health metrics", 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "scrape_frequency": { 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "scrape_frequency", 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "86400", 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to scrape device health metrics", 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "self_heal": { 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "self_heal", 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "preemptively heal cluster around devices that may fail", 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "sleep_interval": { 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "sleep_interval", 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "600", 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.881 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to wake up and check device health", 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warn_threshold": { 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "warn_threshold", 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "7257600", 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "raise health warning if OSD may fail before this long", 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "diskprediction_local", 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.887 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "predict_interval": { 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "predict_interval", 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "86400", 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "predictor_model": { 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "predictor_model", 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "prophetstor", 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "sleep_interval": { 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "sleep_interval", 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "600", 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.890 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "influx", 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": false, 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "influxdb python module not found", 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "batch_size": { 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "batch_size", 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5000", 2024-02-22T18:37:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "database": { 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "database", 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "ceph", 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "hostname": { 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "hostname", 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "30", 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.897 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.898 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "password": { 2024-02-22T18:37:39.899 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "password", 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "port": { 2024-02-22T18:37:39.900 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "port", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "8086", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ssl": { 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ssl", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "false", 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "threads": { 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "threads", 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.902 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5", 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "username": { 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "username", 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:39.903 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "verify_ssl": { 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "verify_ssl", 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "true", 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "insights", 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.908 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "iostat", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.911 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.912 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.913 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.914 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.915 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "k8sevents", 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "ceph_event_retention_days": { 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "ceph_event_retention_days", 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.916 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "7", 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Days to hold ceph event information within local cache", 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "config_check_secs": { 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "config_check_secs", 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.917 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10", 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "10", 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.919 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.920 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.922 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "localpool", 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "failure_domain": { 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "failure_domain", 2024-02-22T18:37:39.923 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "host", 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "failure domain for any created local pool", 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.924 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.925 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.926 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.927 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.928 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min_size": { 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "min_size", 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.929 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "default min_size for any created local pool", 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "num_rep": { 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "num_rep", 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "3", 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.930 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "default replica count for any created local pool", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pg_num": { 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "pg_num", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "128", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "default pg_num for any created local pool", 2024-02-22T18:37:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "prefix": { 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "prefix", 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "name prefix for any created local pool", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "subtree": { 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "subtree", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "rack", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "CRUSH level for which to create a local pool", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "orchestrator", 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.935 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.936 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "orchestrator": { 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "orchestrator", 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "cephadm", 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rook", 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "test_orchestrator" 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Orchestrator backend", 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "osd_support", 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "pg_autoscaler", 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.949 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "sleep_interval": { 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "sleep_interval", 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "progress", 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enabled": { 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "enabled", 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max_completed_events": { 2024-02-22T18:37:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "max_completed_events", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "50", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "number of past completed events to remember", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "persist_interval": { 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "persist_interval", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "5", 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "how frequently to persist completed events", 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "prometheus", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rbd_stats_pools": { 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rbd_stats_pools", 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rbd_stats_pools_refresh_interval": { 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rbd_stats_pools_refresh_interval", 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "300", 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "scrape_interval": { 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "scrape_interval", 2024-02-22T18:37:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_addr": { 2024-02-22T18:37:39.968 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_addr", 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_port": { 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_port", 2024-02-22T18:37:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "stale_cache_strategy": { 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "stale_cache_strategy", 2024-02-22T18:37:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rbd_support", 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mirror_snapshot_schedule": { 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "mirror_snapshot_schedule", 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "trash_purge_schedule": { 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "trash_purge_schedule", 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "restful", 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "key_file": { 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "key_file", 2024-02-22T18:37:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.981 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.982 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.983 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_addr": { 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_addr", 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "server_port": { 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "server_port", 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rook", 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "selftest", 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "roption1": { 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "roption1", 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "roption2": { 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "roption2", 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "xyz", 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption1": { 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption1", 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption2": { 2024-02-22T18:37:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption2", 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption3": { 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption3", 2024-02-22T18:37:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "float", 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption4": { 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption4", 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption5": { 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption5", 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rwoption6": { 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "rwoption6", 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "testkey": { 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "testkey", 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "testlkey": { 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "testlkey", 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "testnewline": { 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "testnewline", 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "status", 2024-02-22T18:37:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.012 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "telegraf", 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "address": { 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "address", 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "15", 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "telemetry", 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "channel_basic": { 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "channel_basic", 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Share basic cluster information (size, version)", 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "channel_crash": { 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "channel_crash", 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "channel_device": { 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "channel_device", 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "True", 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "channel_ident": { 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "channel_ident", 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "contact": { 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "contact", 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "description": { 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "description", 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "device_url": { 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "device_url", 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "https://telemetry.ceph.com/device", 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enabled": { 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "enabled", 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "24", 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "8", 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "last_opt_revision": { 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "last_opt_revision", 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "1", 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "leaderboard": { 2024-02-22T18:37:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "leaderboard", 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "organization": { 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "organization", 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "proxy": { 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "proxy", 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "url": { 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "url", 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "https://telemetry.ceph.com/report", 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "test_orchestrator", 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "volumes", 2024-02-22T18:37:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max_concurrent_clones": { 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "max_concurrent_clones", 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "4", 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "Number of asynchronous cloner threads", 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "zabbix", 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "can_run": true, 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error_string": "", 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "module_options": { 2024-02-22T18:37:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "discovery_interval": { 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "discovery_interval", 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "100", 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "identifier": { 2024-02-22T18:37:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "identifier", 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "interval": { 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "interval", 2024-02-22T18:37:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "secs", 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "60", 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_level": { 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_level", 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster": { 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster", 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_cluster_level": { 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_cluster_level", 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "info", 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [ 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "", 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "critical", 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "debug", 2024-02-22T18:37:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "error", 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "info", 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "warning" 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "log_to_file": { 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "log_to_file", 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "bool", 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 1, 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "False", 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "zabbix_host": { 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "zabbix_host", 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "None", 2024-02-22T18:37:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "zabbix_port": { 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "zabbix_port", 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "int", 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "10051", 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "zabbix_sender": { 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "name": "zabbix_sender", 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "str", 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "level": "advanced", 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "flags": 0, 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "default_value": "/usr/bin/zabbix_sender", 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "min": "", 2024-02-22T18:37:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "max": "", 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "enum_allowed": [], 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "desc": "", 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "long_desc": "", 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "tags": [], 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "see_also": [] 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "services": {}, 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "always_on_modules": { 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nautilus": [ 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "balancer", 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crash", 2024-02-22T18:37:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "devicehealth", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "orchestrator_cli", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "progress", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rbd_support", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "status", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "volumes" 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "octopus": [ 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "balancer", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "crash", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "devicehealth", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "orchestrator", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "pg_autoscaler", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "progress", 2024-02-22T18:37:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "rbd_support", 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "status", 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "telemetry", 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "volumes" 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ], 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "last_failure_osd_epoch": 2, 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "active_clients": [ 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addrvec": [ 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "v2", 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addr": "172.21.15.40:0", 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nonce": 3802138041 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ] 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout }, 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addrvec": [ 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "type": "v2", 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "addr": "172.21.15.40:0", 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "nonce": 2606668330 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ] 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout ] 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:40.067 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:39 smithi040 bash[13988]: audit 2024-02-22T18:37:39.301740+0000 mon.a (mon.0) 66 : audit [DBG] from='client.? 172.21.15.40:0/911672073' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-02-22T18:37:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:Waiting for the mgr to restart... 2024-02-22T18:37:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:Waiting for Mgr epoch 9... 2024-02-22T18:37:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 tell mgr mgr_status 2024-02-22T18:37:42.928 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:37:42 smithi040 bash[14251]: Warning: Permanently added 'smithi040,172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-22T18:37:43.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: cluster 2024-02-22T18:37:42.054307+0000 mon.a (mon.0) 67 : cluster [INF] Active manager daemon y restarted 2024-02-22T18:37:43.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: cluster 2024-02-22T18:37:42.055095+0000 mon.a (mon.0) 68 : cluster [INF] Activating manager daemon y 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: cluster 2024-02-22T18:37:42.058367+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: cluster 2024-02-22T18:37:42.512246+0000 mon.a (mon.0) 70 : cluster [DBG] mgrmap e10: y(active, starting, since 0.457259s) 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.516711+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.518402+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.518884+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.519330+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.520292+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.521601+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.522183+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.522699+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.523215+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.523733+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.524256+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.524797+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T18:37:43.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.525302+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T18:37:43.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.525803+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T18:37:43.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: cluster 2024-02-22T18:37:42.529307+0000 mon.a (mon.0) 85 : cluster [INF] Manager daemon y is now available 2024-02-22T18:37:43.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.720215+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:37:43.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.722512+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:37:43.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:43 smithi040 bash[13988]: audit 2024-02-22T18:37:42.942210+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:37:43.534 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout { 2024-02-22T18:37:43.534 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-22T18:37:43.534 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout "initialized": true 2024-02-22T18:37:43.534 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout } 2024-02-22T18:37:44.551 INFO:teuthology.orchestra.run.smithi040.stderr:Mgr epoch 9 is available 2024-02-22T18:37:44.551 INFO:teuthology.orchestra.run.smithi040.stderr:Generating a dashboard self-signed certificate... 2024-02-22T18:37:44.552 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 dashboard create-self-signed-cert 2024-02-22T18:37:44.995 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:44 smithi040 bash[13988]: audit 2024-02-22T18:37:43.479155+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:37:44.995 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:44 smithi040 bash[13988]: audit 2024-02-22T18:37:43.480245+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:37:44.996 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:44 smithi040 bash[13988]: cluster 2024-02-22T18:37:43.513357+0000 mon.a (mon.0) 91 : cluster [DBG] mgrmap e11: y(active, since 1.45841s) 2024-02-22T18:37:44.996 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:44 smithi040 bash[13988]: audit 2024-02-22T18:37:43.514902+0000 mgr.y (mgr.14138) 1 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-22T18:37:44.996 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:44 smithi040 bash[13988]: audit 2024-02-22T18:37:43.532152+0000 mgr.y (mgr.14138) 2 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-22T18:37:45.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:45 smithi040 bash[13988]: cluster 2024-02-22T18:37:44.515560+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-02-22T18:37:46.272 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-22T18:37:46.880 INFO:teuthology.orchestra.run.smithi040.stderr:Creating initial admin user... 2024-02-22T18:37:46.881 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 dashboard ac-user-create admin dwf70zk886 administrator --force-password --pwd-update-required 2024-02-22T18:37:47.614 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:47 smithi040 bash[13988]: audit 2024-02-22T18:37:46.113396+0000 mgr.y (mgr.14138) 3 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:37:47.614 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:47 smithi040 bash[13988]: audit 2024-02-22T18:37:46.264672+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:37:47.614 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:47 smithi040 bash[13988]: audit 2024-02-22T18:37:46.269401+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:37:48.409 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$uffgSpFW/lbICFBlbNwEbOuRtRaCVbfHirbL1E188NEF0.MUDsWI6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708627068, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-22T18:37:49.020 INFO:teuthology.orchestra.run.smithi040.stderr:Fetching dashboard port number... 2024-02-22T18:37:49.020 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.9 -e NODE_NAME=smithi040 -v /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmp4fy_40_3:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpp168ncp9:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v15.2.9 config get mgr mgr/dashboard/ssl_server_port 2024-02-22T18:37:49.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:49 smithi040 bash[13988]: audit 2024-02-22T18:37:48.147800+0000 mgr.y (mgr.14138) 4 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "dwf70zk886", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:37:49.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:49 smithi040 bash[13988]: cluster 2024-02-22T18:37:48.270931+0000 mon.a (mon.0) 95 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-02-22T18:37:49.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:49 smithi040 bash[13988]: audit 2024-02-22T18:37:48.406644+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:37:50.146 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/ceph: stdout 8443 2024-02-22T18:37:50.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:50 smithi040 bash[13988]: audit 2024-02-22T18:37:50.144720+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.40:0/623176619' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-22T18:37:50.768 INFO:teuthology.orchestra.run.smithi040.stderr:firewalld does not appear to be present 2024-02-22T18:37:50.768 INFO:teuthology.orchestra.run.smithi040.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-22T18:37:50.771 INFO:teuthology.orchestra.run.smithi040.stderr:Ceph Dashboard is now available at: 2024-02-22T18:37:50.772 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-22T18:37:50.772 INFO:teuthology.orchestra.run.smithi040.stderr: URL: https://smithi040.front.sepia.ceph.com:8443/ 2024-02-22T18:37:50.772 INFO:teuthology.orchestra.run.smithi040.stderr: User: admin 2024-02-22T18:37:50.772 INFO:teuthology.orchestra.run.smithi040.stderr: Password: dwf70zk886 2024-02-22T18:37:50.772 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-22T18:37:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:You can access the Ceph CLI with: 2024-02-22T18:37:50.772 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-22T18:37:50.772 INFO:teuthology.orchestra.run.smithi040.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-22T18:37:50.772 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:Please consider enabling telemetry to help improve Ceph: 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr: ceph telemetry on 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:For more information see: 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:Bootstrap complete. 2024-02-22T18:37:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:Releasing lock 139758869241232 on /run/cephadm/42039b9c-d1b1-11ee-95bf-87774f69a715.lock 2024-02-22T18:37:50.774 INFO:teuthology.orchestra.run.smithi040.stderr:Lock 139758869241232 released on /run/cephadm/42039b9c-d1b1-11ee-95bf-87774f69a715.lock 2024-02-22T18:37:50.801 INFO:tasks.cephadm:Fetching config... 2024-02-22T18:37:50.802 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:37:50.802 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-22T18:37:50.809 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-22T18:37:50.809 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:37:50.810 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-22T18:37:50.857 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-22T18:37:50.857 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:37:50.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-22T18:37:50.868 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-22T18:37:50.869 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:37:50.869 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-22T18:37:50.873 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-22T18:37:50.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXvJzlUF+KUvfmYcqcq8VPyLHLR2SWRhc5l3bDd7SuneU9ZJE7EDoOe499YG8mOIwNZ2xAcgC2ZbZL7SzQmK4qvrWvk2OZ0V90zP+Vhsz+ciN/miThu4i9M46O1ejMXs71tD2SxMsemVJ/lXJAxa+WiV0k6rLzhzpBX7wLIHyydw2tPR3dlUtRFurjGkaenr4ufi7JBRQrxN11bBf43yOkbaQioUFN2rAXYWUjgFIwtDv7Qqv9LhyLn8uexIUawj5ivuLzAFpTE4W/PDQFbAqbhwow0E8qca1mNSjby/xwgA/NqQwHX9qN4nUaXqWnxAOwEMM6xaWivOlGDlv1SdGGA/JCJbJbfuiqdJYtNy/w+tZ8mMphmR7AK04oXIg/izs7tIwUsv/Wk1cXZm/6sb8CHIedX0s137fXnD0WPOZnS33jFhw7jpWeXSKFKaDB1D+MwA3OlyJ29XHB9McN11+QxgTUzt1LJ/0Z/mViVSVDDqjW56fs0bHCvQCMqSt+pnE= ceph-42039b9c-d1b1-11ee-95bf-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-22T18:37:50.896 INFO:teuthology.orchestra.run.smithi040.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXvJzlUF+KUvfmYcqcq8VPyLHLR2SWRhc5l3bDd7SuneU9ZJE7EDoOe499YG8mOIwNZ2xAcgC2ZbZL7SzQmK4qvrWvk2OZ0V90zP+Vhsz+ciN/miThu4i9M46O1ejMXs71tD2SxMsemVJ/lXJAxa+WiV0k6rLzhzpBX7wLIHyydw2tPR3dlUtRFurjGkaenr4ufi7JBRQrxN11bBf43yOkbaQioUFN2rAXYWUjgFIwtDv7Qqv9LhyLn8uexIUawj5ivuLzAFpTE4W/PDQFbAqbhwow0E8qca1mNSjby/xwgA/NqQwHX9qN4nUaXqWnxAOwEMM6xaWivOlGDlv1SdGGA/JCJbJbfuiqdJYtNy/w+tZ8mMphmR7AK04oXIg/izs7tIwUsv/Wk1cXZm/6sb8CHIedX0s137fXnD0WPOZnS33jFhw7jpWeXSKFKaDB1D+MwA3OlyJ29XHB9McN11+QxgTUzt1LJ/0Z/mViVSVDDqjW56fs0bHCvQCMqSt+pnE= ceph-42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:37:50.907 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXvJzlUF+KUvfmYcqcq8VPyLHLR2SWRhc5l3bDd7SuneU9ZJE7EDoOe499YG8mOIwNZ2xAcgC2ZbZL7SzQmK4qvrWvk2OZ0V90zP+Vhsz+ciN/miThu4i9M46O1ejMXs71tD2SxMsemVJ/lXJAxa+WiV0k6rLzhzpBX7wLIHyydw2tPR3dlUtRFurjGkaenr4ufi7JBRQrxN11bBf43yOkbaQioUFN2rAXYWUjgFIwtDv7Qqv9LhyLn8uexIUawj5ivuLzAFpTE4W/PDQFbAqbhwow0E8qca1mNSjby/xwgA/NqQwHX9qN4nUaXqWnxAOwEMM6xaWivOlGDlv1SdGGA/JCJbJbfuiqdJYtNy/w+tZ8mMphmR7AK04oXIg/izs7tIwUsv/Wk1cXZm/6sb8CHIedX0s137fXnD0WPOZnS33jFhw7jpWeXSKFKaDB1D+MwA3OlyJ29XHB9McN11+QxgTUzt1LJ/0Z/mViVSVDDqjW56fs0bHCvQCMqSt+pnE= ceph-42039b9c-d1b1-11ee-95bf-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-22T18:37:50.934 INFO:teuthology.orchestra.run.smithi111.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXvJzlUF+KUvfmYcqcq8VPyLHLR2SWRhc5l3bDd7SuneU9ZJE7EDoOe499YG8mOIwNZ2xAcgC2ZbZL7SzQmK4qvrWvk2OZ0V90zP+Vhsz+ciN/miThu4i9M46O1ejMXs71tD2SxMsemVJ/lXJAxa+WiV0k6rLzhzpBX7wLIHyydw2tPR3dlUtRFurjGkaenr4ufi7JBRQrxN11bBf43yOkbaQioUFN2rAXYWUjgFIwtDv7Qqv9LhyLn8uexIUawj5ivuLzAFpTE4W/PDQFbAqbhwow0E8qca1mNSjby/xwgA/NqQwHX9qN4nUaXqWnxAOwEMM6xaWivOlGDlv1SdGGA/JCJbJbfuiqdJYtNy/w+tZ8mMphmR7AK04oXIg/izs7tIwUsv/Wk1cXZm/6sb8CHIedX0s137fXnD0WPOZnS33jFhw7jpWeXSKFKaDB1D+MwA3OlyJ29XHB9McN11+QxgTUzt1LJ/0Z/mViVSVDDqjW56fs0bHCvQCMqSt+pnE= ceph-42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:37:50.940 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi111 2024-02-22T18:37:50.941 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-22T18:37:50.941 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/etc/ceph/ceph.conf 2024-02-22T18:37:50.945 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-22T18:37:50.945 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-22T18:37:50.950 INFO:tasks.cephadm:Adding host smithi111 to orchestrator... 2024-02-22T18:37:50.950 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch host add smithi111 2024-02-22T18:37:56.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:56 smithi040 bash[13988]: audit 2024-02-22T18:37:56.298113+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:37:57.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:57 smithi040 bash[13988]: audit 2024-02-22T18:37:56.602836+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:37:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:57 smithi040 bash[13988]: cephadm 2024-02-22T18:37:56.603763+0000 mgr.y (mgr.14138) 5 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:37:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:57 smithi040 bash[13988]: audit 2024-02-22T18:37:56.980989+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:37:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:57 smithi040 bash[13988]: cephadm 2024-02-22T18:37:56.981608+0000 mgr.y (mgr.14138) 6 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-22T18:37:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:57 smithi040 bash[13988]: audit 2024-02-22T18:37:56.982079+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:37:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:57 smithi040 bash[13988]: audit 2024-02-22T18:37:56.983425+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:37:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:57 smithi040 bash[13988]: cephadm 2024-02-22T18:37:56.984384+0000 mgr.y (mgr.14138) 7 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-22T18:37:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:57 smithi040 bash[13988]: audit 2024-02-22T18:37:56.984920+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2024-02-22T18:38:00.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:59 smithi040 bash[13988]: audit 2024-02-22T18:37:58.821619+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:00.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:59 smithi040 bash[13988]: cephadm 2024-02-22T18:37:58.822541+0000 mgr.y (mgr.14138) 8 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-22T18:38:00.042 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:59 smithi040 bash[13988]: audit 2024-02-22T18:37:58.823069+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-22T18:38:00.042 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:59 smithi040 bash[13988]: audit 2024-02-22T18:37:58.824584+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:00.042 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:59 smithi040 bash[13988]: cephadm 2024-02-22T18:37:58.825978+0000 mgr.y (mgr.14138) 9 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-22T18:38:00.042 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:37:59 smithi040 bash[13988]: audit 2024-02-22T18:37:58.826999+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-22T18:38:01.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:01 smithi040 bash[13988]: audit 2024-02-22T18:38:00.492336+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:01.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:01 smithi040 bash[13988]: audit 2024-02-22T18:38:00.494782+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:01.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:01 smithi040 bash[13988]: audit 2024-02-22T18:38:01.039042+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:01.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:01 smithi040 bash[13988]: audit 2024-02-22T18:38:01.043384+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:03.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:03 smithi040 bash[13988]: cluster 2024-02-22T18:38:02.519880+0000 mgr.y (mgr.14138) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:05.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:05 smithi040 bash[13988]: cluster 2024-02-22T18:38:04.520360+0000 mgr.y (mgr.14138) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:07.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:07 smithi040 bash[13988]: cluster 2024-02-22T18:38:06.520744+0000 mgr.y (mgr.14138) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:08.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:08 smithi040 bash[13988]: cluster 2024-02-22T18:38:08.521159+0000 mgr.y (mgr.14138) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:10 smithi040 bash[13988]: cluster 2024-02-22T18:38:10.521569+0000 mgr.y (mgr.14138) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:12.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:12 smithi040 bash[13988]: cluster 2024-02-22T18:38:12.521962+0000 mgr.y (mgr.14138) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:14.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:14 smithi040 bash[13988]: cluster 2024-02-22T18:38:14.522347+0000 mgr.y (mgr.14138) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:17 smithi040 bash[13988]: cluster 2024-02-22T18:38:16.522713+0000 mgr.y (mgr.14138) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:18.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:18 smithi040 bash[13988]: cluster 2024-02-22T18:38:18.523076+0000 mgr.y (mgr.14138) 18 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:20.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:20 smithi040 bash[13988]: cluster 2024-02-22T18:38:20.523458+0000 mgr.y (mgr.14138) 19 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:22.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:22 smithi040 bash[13988]: cluster 2024-02-22T18:38:22.523885+0000 mgr.y (mgr.14138) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:24.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:24 smithi040 bash[13988]: cluster 2024-02-22T18:38:24.524332+0000 mgr.y (mgr.14138) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:25.927 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:38:25 smithi040 bash[14251]: Warning: Permanently added 'smithi111,172.21.15.111' (ECDSA) to the list of known hosts. 2024-02-22T18:38:26.303 INFO:teuthology.orchestra.run.smithi111.stdout:Added host 'smithi111' 2024-02-22T18:38:26.933 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch host ls --format=json 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: audit 2024-02-22T18:38:25.586982+0000 mgr.y (mgr.14138) 22 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi111", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: audit 2024-02-22T18:38:26.297860+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: cephadm 2024-02-22T18:38:26.298708+0000 mgr.y (mgr.14138) 23 : cephadm [INF] Added host smithi111 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: audit 2024-02-22T18:38:26.302456+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: cluster 2024-02-22T18:38:26.524744+0000 mgr.y (mgr.14138) 24 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: audit 2024-02-22T18:38:26.665101+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: audit 2024-02-22T18:38:26.666459+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: audit 2024-02-22T18:38:26.839401+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: audit 2024-02-22T18:38:26.956983+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:27 smithi040 bash[13988]: audit 2024-02-22T18:38:26.958380+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:38:28.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:28 smithi040 bash[13988]: cluster 2024-02-22T18:38:28.525216+0000 mgr.y (mgr.14138) 25 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-02-22T18:38:30.693 INFO:teuthology.orchestra.run.smithi111.stdout:[{"addr": "smithi040", "hostname": "smithi040", "labels": [], "status": ""}, {"addr": "smithi111", "hostname": "smithi111", "labels": [], "status": ""}] 2024-02-22T18:38:30.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:30 smithi040 bash[13988]: cluster 2024-02-22T18:38:30.525621+0000 mgr.y (mgr.14138) 26 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:31.300 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-22T18:38:31.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd crush tunables default 2024-02-22T18:38:32.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:32 smithi040 bash[13988]: audit 2024-02-22T18:38:30.689028+0000 mgr.y (mgr.14138) 27 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T18:38:32.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:32 smithi040 bash[13988]: audit 2024-02-22T18:38:32.207564+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:32.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:32 smithi040 bash[13988]: audit 2024-02-22T18:38:32.512127+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:33.848 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:33 smithi040 bash[13988]: cephadm 2024-02-22T18:38:32.513057+0000 mgr.y (mgr.14138) 28 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:38:33.848 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:33 smithi040 bash[13988]: cluster 2024-02-22T18:38:32.525927+0000 mgr.y (mgr.14138) 29 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:33.848 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:33 smithi040 bash[13988]: audit 2024-02-22T18:38:32.930972+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:33.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:33 smithi040 bash[13988]: audit 2024-02-22T18:38:32.938957+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:34.544 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-02-22T18:38:34.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:34 smithi040 bash[13988]: audit 2024-02-22T18:38:34.134247+0000 mon.a (mon.0) 123 : audit [INF] from='client.? 172.21.15.40:0/3813096245' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-22T18:38:35.174 INFO:tasks.cephadm:Adding mon.c on smithi040 2024-02-22T18:38:35.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add mon 'smithi040:[v2:172.21.15.40:3301,v1:172.21.15.40:6790]=c' 2024-02-22T18:38:35.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:35 smithi040 bash[13988]: cluster 2024-02-22T18:38:34.526268+0000 mgr.y (mgr.14138) 30 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:35.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:35 smithi040 bash[13988]: audit 2024-02-22T18:38:34.536779+0000 mon.a (mon.0) 124 : audit [INF] from='client.? 172.21.15.40:0/3813096245' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-22T18:38:35.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:35 smithi040 bash[13988]: cluster 2024-02-22T18:38:34.536879+0000 mon.a (mon.0) 125 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-22T18:38:35.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:35 smithi040 bash[13988]: audit 2024-02-22T18:38:34.537453+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2024-02-22T18:38:36.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:36 smithi040 bash[13988]: audit 2024-02-22T18:38:35.538397+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2024-02-22T18:38:36.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:36 smithi040 bash[13988]: cluster 2024-02-22T18:38:35.538603+0000 mon.a (mon.0) 128 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-22T18:38:36.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:36 smithi040 bash[13988]: audit 2024-02-22T18:38:35.544020+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T18:38:37.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:37 smithi040 bash[13988]: cluster 2024-02-22T18:38:36.526703+0000 mgr.y (mgr.14138) 31 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:37.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:37 smithi040 bash[13988]: audit 2024-02-22T18:38:36.544101+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T18:38:37.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:37 smithi040 bash[13988]: cluster 2024-02-22T18:38:36.544247+0000 mon.a (mon.0) 131 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T18:38:38.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:38 smithi040 bash[13988]: audit 2024-02-22T18:38:37.832642+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:38:38.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:38 smithi040 bash[13988]: audit 2024-02-22T18:38:37.834054+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:38.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:38 smithi040 bash[13988]: audit 2024-02-22T18:38:37.835647+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-02-22T18:38:39.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:39 smithi040 bash[13988]: audit 2024-02-22T18:38:37.830080+0000 mgr.y (mgr.14138) 32 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi040:[v2:172.21.15.40:3301,v1:172.21.15.40:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:38:39.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:39 smithi040 bash[13988]: cephadm 2024-02-22T18:38:37.835162+0000 mgr.y (mgr.14138) 33 : cephadm [INF] Deploying daemon mon.c on smithi040 2024-02-22T18:38:39.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:39 smithi040 bash[13988]: cluster 2024-02-22T18:38:38.527156+0000 mgr.y (mgr.14138) 34 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:41.568 INFO:teuthology.orchestra.run.smithi040.stdout:Deployed mon.c on host 'smithi040' 2024-02-22T18:38:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:41 smithi040 bash[13988]: cluster 2024-02-22T18:38:40.527504+0000 mgr.y (mgr.14138) 35 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:42.747 DEBUG:teuthology.orchestra.run.smithi040:mon.c> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.c.service 2024-02-22T18:38:42.750 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T18:38:42.750 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph mon dump -f json 2024-02-22T18:38:42.865 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[13988]: audit 2024-02-22T18:38:41.563307+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:42.865 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[13988]: audit 2024-02-22T18:38:41.565180+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:43.243 INFO:journalctl@ceph.mon.c.smithi040.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:38:43.243 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.941+0000 7f6cf1666700 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.941+0000 7f6cf1666700 0 ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable), process ceph-mon, pid 1 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.945+0000 7f6cf1666700 0 pidfile_write: ignore empty --pid-file 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 0 load: jerasure load: lrc load: isa 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 0 set rocksdb option compression = kNoCompression 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 0 set rocksdb option compression = kNoCompression 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 1 rocksdb: do_open column families: [default] 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: RocksDB version: 6.1.2 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T18:38:43.244 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Compile date Feb 23 2021 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: DB SUMMARY 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: CURRENT file: CURRENT 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: IDENTITY file: IDENTITY 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 489 ; 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.error_if_exists: 0 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.create_if_missing: 0 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.env: 0x563d07cbf1a0 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.info_log: 0x563d09084ba0 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.statistics: (nil) 2024-02-22T18:38:43.245 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.use_fsync: 0 2024-02-22T18:38:43.247 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T18:38:43.247 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T18:38:43.247 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T18:38:43.247 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T18:38:43.247 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.db_log_dir: 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T18:38:43.248 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.write_buffer_manager: 0x563d09069320 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T18:38:43.249 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.row_cache: None 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.wal_filter: None 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.two_write_queues: 0 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.atomic_flush: 0 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T18:38:43.250 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_open_files: -1 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Compression algorithms supported: 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T18:38:43.251 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: kZSTD supported: 0 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: kXpressCompression supported: 0 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: kZlibCompression supported: 1 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.merge_operator: 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_filter: None 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T18:38:43.252 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563d08f9f0d0) 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: cache_index_and_filter_blocks: 1 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: cache_index_and_filter_blocks_with_high_priority: 1 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: pin_top_level_index_and_filter: 1 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: index_type: 0 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: data_block_index_type: 0 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: data_block_hash_table_util_ratio: 0.750000 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: hash_index_allow_collision: 1 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: checksum: 1 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: no_block_cache: 0 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: block_cache: 0x563d08fd6610 2024-02-22T18:38:43.253 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: block_cache_name: BinnedLRUCache 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: block_cache_options: 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: capacity : 536870912 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: num_shard_bits : 4 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: strict_capacity_limit : 0 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: high_pri_pool_ratio: 0.000 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: block_cache_compressed: (nil) 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: persistent_cache: (nil) 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: block_size: 4096 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: block_size_deviation: 10 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: block_restart_interval: 16 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: index_block_restart_interval: 1 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: metadata_block_size: 4096 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: partition_filters: 0 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: use_delta_encoding: 1 2024-02-22T18:38:43.254 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: whole_key_filtering: 1 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: verify_compression: 0 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: read_amp_bytes_per_bit: 0 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: format_version: 2 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: enable_index_compression: 1 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: block_align: 0 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compression: NoCompression 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.num_levels: 7 2024-02-22T18:38:43.255 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T18:38:43.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T18:38:43.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T18:38:43.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.table_properties_collectors: 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.bloom_locality: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T18:38:43.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: Options.ttl: 0 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708627122955931, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.949+0000 7f6cf1666700 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.953+0000 7f6cf1666700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708627122956811, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1403, "table_properties": {"data_size": 501, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 379, "raw_average_value_size": 75, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.953+0000 7f6cf1666700 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.953+0000 7f6cf1666700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708627122957492, "job": 1, "event": "recovery_finished"} 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.953+0000 7f6cf1666700 4 rocksdb: DB pointer 0x563d09c02400 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.953+0000 7f6cd84d1700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.953+0000 7f6cd84d1700 4 rocksdb: [db/db_impl.cc:778] 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ** DB Stats ** 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:38:43.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ** Compaction Stats [default] ** 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ** Compaction Stats [default] ** 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:38:43.261 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ** Compaction Stats [default] ** 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:38:43.262 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ** Compaction Stats [default] ** 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.6 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Cumulative compaction: 0.00 GB write, 0.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:38:43.263 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.953+0000 7f6cf1666700 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.957+0000 7f6cf1666700 0 using public_addrv [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.957+0000 7f6cf1666700 0 starting mon.c rank -1 at public addrs [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] at bind addrs [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.957+0000 7f6cf1666700 1 mon.c@-1(???) e0 preinit fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 0 mon.c@-1(synchronizing).mds e1 new map 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 0 mon.c@-1(synchronizing).mds e1 print_map 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: e1 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: legacy client fscid: -1 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: No filesystems configured 2024-02-22T18:38:43.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.981+0000 7f6cdacd6700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: audit 2024-02-22T18:38:41.563307+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: audit 2024-02-22T18:38:41.565180+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:43.265 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 10 mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta expand map: {default=false} 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta from 'false' to 'false' 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta expanded map: {default=false} 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta expand map: {default=info} 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta from 'info' to 'info' 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta expanded map: {default=info} 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta expand map: {default=daemon} 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta from 'daemon' to 'daemon' 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta expanded map: {default=daemon} 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta expand map: {default=debug} 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta from 'debug' to 'debug' 2024-02-22T18:38:43.266 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:42 smithi040 bash[17964]: debug 2024-02-22T18:38:42.985+0000 7f6cdacd6700 20 expand_channel_meta expanded map: {default=debug} 2024-02-22T18:38:48.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:42.998995+0000 mon.a (mon.0) 140 : cluster [INF] mon.a calling monitor election 2024-02-22T18:38:48.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:43.994900+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:44.528430+0000 mgr.y (mgr.14138) 37 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:48.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:44.994899+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:44.997361+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-22T18:38:48.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:45.994860+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:46.528848+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:46.994923+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:47.994989+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:48.021872+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:48.035139+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:48.035281+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:48.035377+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:48.035914+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 65s) 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: cluster 2024-02-22T18:38:48.045664+0000 mon.a (mon.0) 151 : cluster [INF] overall HEALTH_OK 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:48.050854+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:48.058880+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:48.060196+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:48.061833+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:48.372 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[13988]: audit 2024-02-22T18:38:48.063771+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:42.998995+0000 mon.a (mon.0) 140 : cluster [INF] mon.a calling monitor election 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:43.994900+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:44.528430+0000 mgr.y (mgr.14138) 37 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:44.994899+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:44.997361+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:45.994860+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:46.528848+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:46.994923+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:47.994989+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:48.021872+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:48.035139+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:48.035281+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:48.035377+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:48.035914+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 65s) 2024-02-22T18:38:48.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: cluster 2024-02-22T18:38:48.045664+0000 mon.a (mon.0) 151 : cluster [INF] overall HEALTH_OK 2024-02-22T18:38:48.374 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:48.050854+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:48.374 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:48.058880+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:48.374 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:48.060196+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:38:48.374 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:48.061833+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:48.374 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:48 smithi040 bash[17964]: audit 2024-02-22T18:38:48.063771+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2024-02-22T18:38:48.687 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:38:48.687 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"fsid":"42039b9c-d1b1-11ee-95bf-87774f69a715","modified":"2024-02-22T18:38:42.994932Z","created":"2024-02-22T18:36:56.041700Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3301","nonce":0},{"type":"v1","addr":"172.21.15.40:6790","nonce":0}]},"addr":"172.21.15.40:6790/0","public_addr":"172.21.15.40:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2024-02-22T18:38:48.690 INFO:teuthology.orchestra.run.smithi040.stderr:dumped monmap epoch 2 2024-02-22T18:38:49.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[13988]: cephadm 2024-02-22T18:38:48.059630+0000 mgr.y (mgr.14138) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-22T18:38:49.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[13988]: cephadm 2024-02-22T18:38:48.063075+0000 mgr.y (mgr.14138) 40 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-22T18:38:49.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[13988]: cluster 2024-02-22T18:38:48.529307+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:49.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[13988]: audit 2024-02-22T18:38:48.685174+0000 mon.a (mon.0) 157 : audit [DBG] from='client.? 172.21.15.40:0/2423758955' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T18:38:49.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[13988]: audit 2024-02-22T18:38:48.995348+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:49.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[17964]: cephadm 2024-02-22T18:38:48.059630+0000 mgr.y (mgr.14138) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-22T18:38:49.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[17964]: cephadm 2024-02-22T18:38:48.063075+0000 mgr.y (mgr.14138) 40 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-22T18:38:49.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[17964]: cluster 2024-02-22T18:38:48.529307+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:49.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[17964]: audit 2024-02-22T18:38:48.685174+0000 mon.a (mon.0) 157 : audit [DBG] from='client.? 172.21.15.40:0/2423758955' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T18:38:49.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:49 smithi040 bash[17964]: audit 2024-02-22T18:38:48.995348+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:38:49.833 INFO:tasks.cephadm:Adding mon.b on smithi111 2024-02-22T18:38:49.833 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add mon smithi111:172.21.15.111=b 2024-02-22T18:38:50.924 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[17964]: cluster 2024-02-22T18:38:50.529831+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:50.924 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[17964]: audit 2024-02-22T18:38:50.605837+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:50.924 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[17964]: audit 2024-02-22T18:38:50.607597+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-22T18:38:50.924 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[17964]: audit 2024-02-22T18:38:50.609125+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:50.924 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[17964]: audit 2024-02-22T18:38:50.611831+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-22T18:38:50.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[13988]: cluster 2024-02-22T18:38:50.529831+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:50.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[13988]: audit 2024-02-22T18:38:50.605837+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:50.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[13988]: audit 2024-02-22T18:38:50.607597+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-22T18:38:50.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[13988]: audit 2024-02-22T18:38:50.609125+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:50.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:50 smithi040 bash[13988]: audit 2024-02-22T18:38:50.611831+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-22T18:38:52.808 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[13988]: cephadm 2024-02-22T18:38:50.607028+0000 mgr.y (mgr.14138) 43 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[13988]: cephadm 2024-02-22T18:38:50.610633+0000 mgr.y (mgr.14138) 44 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[13988]: audit 2024-02-22T18:38:52.402382+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[13988]: audit 2024-02-22T18:38:52.404596+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[13988]: audit 2024-02-22T18:38:52.406841+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[13988]: audit 2024-02-22T18:38:52.483855+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[13988]: audit 2024-02-22T18:38:52.485179+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[13988]: audit 2024-02-22T18:38:52.486372+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[13988]: audit 2024-02-22T18:38:52.487716+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[17964]: cephadm 2024-02-22T18:38:50.607028+0000 mgr.y (mgr.14138) 43 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[17964]: cephadm 2024-02-22T18:38:50.610633+0000 mgr.y (mgr.14138) 44 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-22T18:38:52.809 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[17964]: audit 2024-02-22T18:38:52.402382+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:38:52.810 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[17964]: audit 2024-02-22T18:38:52.404596+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:52.810 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[17964]: audit 2024-02-22T18:38:52.406841+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-22T18:38:52.810 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[17964]: audit 2024-02-22T18:38:52.483855+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:52.810 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[17964]: audit 2024-02-22T18:38:52.485179+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:38:52.810 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[17964]: audit 2024-02-22T18:38:52.486372+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:38:52.810 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:52 smithi040 bash[17964]: audit 2024-02-22T18:38:52.487716+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-02-22T18:38:53.824 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[17964]: audit 2024-02-22T18:38:52.399934+0000 mgr.y (mgr.14138) 45 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi111:172.21.15.111=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:38:53.824 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[17964]: cephadm 2024-02-22T18:38:52.406135+0000 mgr.y (mgr.14138) 46 : cephadm [INF] Deploying daemon mon.b on smithi111 2024-02-22T18:38:53.824 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[17964]: cephadm 2024-02-22T18:38:52.484707+0000 mgr.y (mgr.14138) 47 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T18:38:53.824 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[17964]: cephadm 2024-02-22T18:38:52.487215+0000 mgr.y (mgr.14138) 48 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-22T18:38:53.824 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[17964]: cluster 2024-02-22T18:38:52.530430+0000 mgr.y (mgr.14138) 49 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:53.824 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[13988]: audit 2024-02-22T18:38:52.399934+0000 mgr.y (mgr.14138) 45 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi111:172.21.15.111=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:38:53.824 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[13988]: cephadm 2024-02-22T18:38:52.406135+0000 mgr.y (mgr.14138) 46 : cephadm [INF] Deploying daemon mon.b on smithi111 2024-02-22T18:38:53.824 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[13988]: cephadm 2024-02-22T18:38:52.484707+0000 mgr.y (mgr.14138) 47 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T18:38:53.825 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[13988]: cephadm 2024-02-22T18:38:52.487215+0000 mgr.y (mgr.14138) 48 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-22T18:38:53.825 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:53 smithi040 bash[13988]: cluster 2024-02-22T18:38:52.530430+0000 mgr.y (mgr.14138) 49 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:55.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[13988]: audit 2024-02-22T18:38:54.440926+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:55.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[13988]: audit 2024-02-22T18:38:54.443311+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:55.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[13988]: cluster 2024-02-22T18:38:54.530889+0000 mgr.y (mgr.14138) 50 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:55.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[13988]: audit 2024-02-22T18:38:55.025421+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:55.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[13988]: audit 2024-02-22T18:38:55.031155+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[17964]: audit 2024-02-22T18:38:54.440926+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[17964]: audit 2024-02-22T18:38:54.443311+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[17964]: cluster 2024-02-22T18:38:54.530889+0000 mgr.y (mgr.14138) 50 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[17964]: audit 2024-02-22T18:38:55.025421+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:55 smithi040 bash[17964]: audit 2024-02-22T18:38:55.031155+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:56.456 INFO:teuthology.orchestra.run.smithi111.stdout:Deployed mon.b on host 'smithi111' 2024-02-22T18:38:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:56 smithi040 bash[13988]: audit 2024-02-22T18:38:56.442122+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:56 smithi040 bash[13988]: audit 2024-02-22T18:38:56.442856+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:56 smithi040 bash[13988]: audit 2024-02-22T18:38:56.447827+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:56.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:56 smithi040 bash[17964]: audit 2024-02-22T18:38:56.442122+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:56.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:56 smithi040 bash[17964]: audit 2024-02-22T18:38:56.442856+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:38:56.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:56 smithi040 bash[17964]: audit 2024-02-22T18:38:56.447827+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:57.567 DEBUG:teuthology.orchestra.run.smithi111:mon.b> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.b.service 2024-02-22T18:38:57.570 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-22T18:38:57.570 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph mon dump -f json 2024-02-22T18:38:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:57 smithi040 bash[13988]: cluster 2024-02-22T18:38:56.531238+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:57 smithi040 bash[13988]: audit 2024-02-22T18:38:57.047165+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:57 smithi040 bash[13988]: audit 2024-02-22T18:38:57.201322+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:57.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:38:57 smithi040 bash[13988]: audit 2024-02-22T18:38:57.399365+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:57 smithi040 bash[17964]: cluster 2024-02-22T18:38:56.531238+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:57 smithi040 bash[17964]: audit 2024-02-22T18:38:57.047165+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:57 smithi040 bash[17964]: audit 2024-02-22T18:38:57.201322+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:38:57 smithi040 bash[17964]: audit 2024-02-22T18:38:57.399365+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:58.380 INFO:journalctl@ceph.mon.b.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:38:58.380 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.768+0000 7fcab6419700 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.768+0000 7fcab6419700 0 ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable), process ceph-mon, pid 1 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.768+0000 7fcab6419700 0 pidfile_write: ignore empty --pid-file 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 0 load: jerasure load: lrc load: isa 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 0 set rocksdb option compression = kNoCompression 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 0 set rocksdb option compression = kNoCompression 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T18:38:58.381 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 1 rocksdb: do_open column families: [default] 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: RocksDB version: 6.1.2 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Compile date Feb 23 2021 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: DB SUMMARY 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: CURRENT file: CURRENT 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: IDENTITY file: IDENTITY 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 610 ; 2024-02-22T18:38:58.382 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.error_if_exists: 0 2024-02-22T18:38:58.383 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.create_if_missing: 0 2024-02-22T18:38:58.383 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T18:38:58.383 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.env: 0x56516634a1a0 2024-02-22T18:38:58.383 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.info_log: 0x565168270ba0 2024-02-22T18:38:58.383 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T18:38:58.383 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.statistics: (nil) 2024-02-22T18:38:58.383 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.use_fsync: 0 2024-02-22T18:38:58.385 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T18:38:58.385 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T18:38:58.385 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T18:38:58.385 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T18:38:58.385 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T18:38:58.385 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T18:38:58.385 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T18:38:58.385 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.db_log_dir: 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T18:38:58.386 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.write_buffer_manager: 0x565168255290 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T18:38:58.387 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.row_cache: None 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.wal_filter: None 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T18:38:58.388 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.two_write_queues: 0 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.atomic_flush: 0 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T18:38:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_open_files: -1 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Compression algorithms supported: 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: kZSTD supported: 0 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: kXpressCompression supported: 0 2024-02-22T18:38:58.390 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: kZlibCompression supported: 1 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.merge_operator: 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_filter: None 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T18:38:58.391 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56516818b0d0) 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: cache_index_and_filter_blocks: 1 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: cache_index_and_filter_blocks_with_high_priority: 1 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: pin_top_level_index_and_filter: 1 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: index_type: 0 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: data_block_index_type: 0 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: data_block_hash_table_util_ratio: 0.750000 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: hash_index_allow_collision: 1 2024-02-22T18:38:58.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: checksum: 1 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: no_block_cache: 0 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: block_cache: 0x5651681c2610 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: block_cache_name: BinnedLRUCache 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: block_cache_options: 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: capacity : 536870912 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: num_shard_bits : 4 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: strict_capacity_limit : 0 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: high_pri_pool_ratio: 0.000 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: block_cache_compressed: (nil) 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: persistent_cache: (nil) 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: block_size: 4096 2024-02-22T18:38:58.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: block_size_deviation: 10 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: block_restart_interval: 16 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: index_block_restart_interval: 1 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: metadata_block_size: 4096 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: partition_filters: 0 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: use_delta_encoding: 1 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: whole_key_filtering: 1 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: verify_compression: 0 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: read_amp_bytes_per_bit: 0 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: format_version: 2 2024-02-22T18:38:58.394 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: enable_index_compression: 1 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: block_align: 0 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compression: NoCompression 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.num_levels: 7 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T18:38:58.395 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T18:38:58.396 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T18:38:58.397 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T18:38:58.398 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.table_properties_collectors: 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T18:38:58.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.bloom_locality: 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: Options.ttl: 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.772+0000 7fcab6419700 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.776+0000 7fcab6419700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708627137777798, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-22T18:38:58.400 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.776+0000 7fcab6419700 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.776+0000 7fcab6419700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708627137778782, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1524, "table_properties": {"data_size": 622, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 500, "raw_average_value_size": 100, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.776+0000 7fcab6419700 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.776+0000 7fcab6419700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708627137779613, "job": 1, "event": "recovery_finished"} 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.780+0000 7fcab6419700 4 rocksdb: DB pointer 0x565168dee400 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.780+0000 7fca9d284700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.780+0000 7fca9d284700 4 rocksdb: [db/db_impl.cc:778] 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ** DB Stats ** 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T18:38:58.401 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ** Compaction Stats [default] ** 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ** Compaction Stats [default] ** 2024-02-22T18:38:58.402 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:38:58.403 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:38:58.403 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:58.403 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:38:58.403 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T18:38:58.403 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T18:38:58.403 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T18:38:58.403 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Cumulative compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Interval compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ** Compaction Stats [default] ** 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:58.404 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ** Compaction Stats [default] ** 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:38:58.405 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.780+0000 7fcab6419700 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.780+0000 7fcab6419700 0 using public_addr v2:172.21.15.111:0/0 -> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.780+0000 7fcab6419700 0 starting mon.b rank -1 at public addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] at bind addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.784+0000 7fcab6419700 1 mon.b@-1(???) e0 preinit fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.808+0000 7fca9fa89700 0 mon.b@-1(synchronizing).mds e1 new map 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.808+0000 7fca9fa89700 0 mon.b@-1(synchronizing).mds e1 print_map 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: e1 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-22T18:38:58.406 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: legacy client fscid: -1 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: No filesystems configured 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.808+0000 7fca9fa89700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T18:38:58.407 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: cluster 2024-02-22T18:38:56.531238+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: audit 2024-02-22T18:38:57.047165+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: audit 2024-02-22T18:38:57.201322+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: audit 2024-02-22T18:38:57.399365+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta expand map: {default=false} 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta from 'false' to 'false' 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta expanded map: {default=false} 2024-02-22T18:38:58.408 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta expand map: {default=info} 2024-02-22T18:38:58.409 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta from 'info' to 'info' 2024-02-22T18:38:58.409 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta expanded map: {default=info} 2024-02-22T18:38:58.409 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta expand map: {default=daemon} 2024-02-22T18:38:58.409 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta from 'daemon' to 'daemon' 2024-02-22T18:38:58.409 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta expanded map: {default=daemon} 2024-02-22T18:38:58.409 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta expand map: {default=debug} 2024-02-22T18:38:58.409 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta from 'debug' to 'debug' 2024-02-22T18:38:58.409 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:38:57 smithi111 bash[14162]: debug 2024-02-22T18:38:57.812+0000 7fca9fa89700 20 expand_channel_meta expanded map: {default=debug} 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:38:57.826093+0000 mon.a (mon.0) 181 : cluster [INF] mon.a calling monitor election 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:38:57.826750+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:38:58.531633+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: audit 2024-02-22T18:38:58.819107+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: audit 2024-02-22T18:38:59.819453+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:00.532051+0000 mgr.y (mgr.14138) 54 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: audit 2024-02-22T18:39:00.819683+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: audit 2024-02-22T18:39:01.819587+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.532474+0000 mgr.y (mgr.14138) 55 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: audit 2024-02-22T18:39:02.819713+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.828505+0000 mon.a (mon.0) 187 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.833821+0000 mon.a (mon.0) 188 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.833925+0000 mon.a (mon.0) 189 : cluster [DBG] fsmap 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.833985+0000 mon.a (mon.0) 190 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.834347+0000 mon.a (mon.0) 191 : cluster [DBG] mgrmap e13: y(active, since 80s) 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.834679+0000 mon.a (mon.0) 192 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.841413+0000 mon.a (mon.0) 193 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.841459+0000 mon.a (mon.0) 194 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[13988]: cluster 2024-02-22T18:39:02.841483+0000 mon.a (mon.0) 195 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] is down (out of quorum) 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:38:57.826093+0000 mon.a (mon.0) 181 : cluster [INF] mon.a calling monitor election 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:38:57.826750+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:38:58.531633+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:03.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: audit 2024-02-22T18:38:58.819107+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: audit 2024-02-22T18:38:59.819453+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:00.532051+0000 mgr.y (mgr.14138) 54 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: audit 2024-02-22T18:39:00.819683+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: audit 2024-02-22T18:39:01.819587+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.532474+0000 mgr.y (mgr.14138) 55 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: audit 2024-02-22T18:39:02.819713+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.828505+0000 mon.a (mon.0) 187 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.833821+0000 mon.a (mon.0) 188 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.833925+0000 mon.a (mon.0) 189 : cluster [DBG] fsmap 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.833985+0000 mon.a (mon.0) 190 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.834347+0000 mon.a (mon.0) 191 : cluster [DBG] mgrmap e13: y(active, since 80s) 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.834679+0000 mon.a (mon.0) 192 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.841413+0000 mon.a (mon.0) 193 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-22T18:39:03.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.841459+0000 mon.a (mon.0) 194 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-22T18:39:03.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:02 smithi040 bash[17964]: cluster 2024-02-22T18:39:02.841483+0000 mon.a (mon.0) 195 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] is down (out of quorum) 2024-02-22T18:39:03.484 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-02-22T18:39:03.484 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":3,"fsid":"42039b9c-d1b1-11ee-95bf-87774f69a715","modified":"2024-02-22T18:38:57.819339Z","created":"2024-02-22T18:36:56.041700Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3301","nonce":0},{"type":"v1","addr":"172.21.15.40:6790","nonce":0}]},"addr":"172.21.15.40:6790/0","public_addr":"172.21.15.40:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0}],"quorum":[0,1]} 2024-02-22T18:39:03.487 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 3 2024-02-22T18:39:04.076 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-22T18:39:04.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph config generate-minimal-conf 2024-02-22T18:39:04.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:03 smithi040 bash[13988]: audit 2024-02-22T18:39:03.481780+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.15.111:0/264974066' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T18:39:04.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:03 smithi040 bash[13988]: audit 2024-02-22T18:39:03.820015+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:04.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:03 smithi040 bash[17964]: audit 2024-02-22T18:39:03.481780+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.15.111:0/264974066' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T18:39:04.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:03 smithi040 bash[17964]: audit 2024-02-22T18:39:03.820015+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:38:59.822496+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.825320+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.825365+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.825509+0000 mon.a (mon.0) 199 : cluster [INF] mon.a calling monitor election 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.849495+0000 mon.a (mon.0) 200 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.855546+0000 mon.a (mon.0) 201 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.855664+0000 mon.a (mon.0) 202 : cluster [DBG] fsmap 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.855723+0000 mon.a (mon.0) 203 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.856164+0000 mon.a (mon.0) 204 : cluster [DBG] mgrmap e13: y(active, since 82s) 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.856498+0000 mon.a (mon.0) 205 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.856551+0000 mon.a (mon.0) 206 : cluster [INF] Cluster is now healthy 2024-02-22T18:39:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[13988]: cluster 2024-02-22T18:39:04.863420+0000 mon.a (mon.0) 207 : cluster [INF] overall HEALTH_OK 2024-02-22T18:39:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:38:59.822496+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-22T18:39:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.825320+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-22T18:39:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.825365+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-02-22T18:39:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.825509+0000 mon.a (mon.0) 199 : cluster [INF] mon.a calling monitor election 2024-02-22T18:39:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.849495+0000 mon.a (mon.0) 200 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T18:39:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.855546+0000 mon.a (mon.0) 201 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-22T18:39:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.855664+0000 mon.a (mon.0) 202 : cluster [DBG] fsmap 2024-02-22T18:39:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.855723+0000 mon.a (mon.0) 203 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T18:39:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.856164+0000 mon.a (mon.0) 204 : cluster [DBG] mgrmap e13: y(active, since 82s) 2024-02-22T18:39:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.856498+0000 mon.a (mon.0) 205 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-22T18:39:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.856551+0000 mon.a (mon.0) 206 : cluster [INF] Cluster is now healthy 2024-02-22T18:39:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:04 smithi040 bash[17964]: cluster 2024-02-22T18:39:04.863420+0000 mon.a (mon.0) 207 : cluster [INF] overall HEALTH_OK 2024-02-22T18:39:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: audit 2024-02-22T18:39:03.481780+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.15.111:0/264974066' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T18:39:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: audit 2024-02-22T18:39:03.820015+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:38:59.822496+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-22T18:39:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.825320+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-22T18:39:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.825365+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-02-22T18:39:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.825509+0000 mon.a (mon.0) 199 : cluster [INF] mon.a calling monitor election 2024-02-22T18:39:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.849495+0000 mon.a (mon.0) 200 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T18:39:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.855546+0000 mon.a (mon.0) 201 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-22T18:39:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.855664+0000 mon.a (mon.0) 202 : cluster [DBG] fsmap 2024-02-22T18:39:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.855723+0000 mon.a (mon.0) 203 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T18:39:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.856164+0000 mon.a (mon.0) 204 : cluster [DBG] mgrmap e13: y(active, since 82s) 2024-02-22T18:39:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.856498+0000 mon.a (mon.0) 205 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-22T18:39:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.856551+0000 mon.a (mon.0) 206 : cluster [INF] Cluster is now healthy 2024-02-22T18:39:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:04 smithi111 bash[14162]: cluster 2024-02-22T18:39:04.863420+0000 mon.a (mon.0) 207 : cluster [INF] overall HEALTH_OK 2024-02-22T18:39:06.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:05 smithi040 bash[13988]: audit 2024-02-22T18:39:05.820258+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:05 smithi040 bash[17964]: audit 2024-02-22T18:39:05.820258+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:06.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:05 smithi111 bash[14162]: audit 2024-02-22T18:39:05.820258+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:39:06.718 INFO:teuthology.orchestra.run.smithi040.stdout:# minimal ceph.conf for 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:39:06.718 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-02-22T18:39:06.718 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:39:06.718 INFO:teuthology.orchestra.run.smithi040.stdout: mon_host = [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] 2024-02-22T18:39:07.366 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-22T18:39:07.366 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:39:07.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.conf 2024-02-22T18:39:07.377 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:39:07.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-22T18:39:07.438 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-22T18:39:07.438 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.conf 2024-02-22T18:39:07.455 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-22T18:39:07.455 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-22T18:39:07.470 INFO:tasks.cephadm:Adding mgr.y on smithi040 2024-02-22T18:39:07.470 INFO:tasks.cephadm:Adding mgr.x on smithi111 2024-02-22T18:39:07.470 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch apply mgr '2;smithi040=y;smithi111=x' 2024-02-22T18:39:07.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:07 smithi040 bash[13988]: cluster 2024-02-22T18:39:06.533288+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:07.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:07 smithi040 bash[13988]: audit 2024-02-22T18:39:06.715446+0000 mon.a (mon.0) 209 : audit [DBG] from='client.? 172.21.15.40:0/1304038782' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:07.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:07 smithi040 bash[17964]: cluster 2024-02-22T18:39:06.533288+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:07.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:07 smithi040 bash[17964]: audit 2024-02-22T18:39:06.715446+0000 mon.a (mon.0) 209 : audit [DBG] from='client.? 172.21.15.40:0/1304038782' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:07.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:07 smithi111 bash[14162]: cluster 2024-02-22T18:39:06.533288+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:07.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:07 smithi111 bash[14162]: audit 2024-02-22T18:39:06.715446+0000 mon.a (mon.0) 209 : audit [DBG] from='client.? 172.21.15.40:0/1304038782' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:08.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:08 smithi111 bash[14162]: cluster 2024-02-22T18:39:08.533727+0000 mgr.y (mgr.14138) 58 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:09.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:08 smithi040 bash[13988]: cluster 2024-02-22T18:39:08.533727+0000 mgr.y (mgr.14138) 58 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:09.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:08 smithi040 bash[17964]: cluster 2024-02-22T18:39:08.533727+0000 mgr.y (mgr.14138) 58 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:09.986 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled mgr update... 2024-02-22T18:39:10.542 DEBUG:teuthology.orchestra.run.smithi111:mgr.x> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.x.service 2024-02-22T18:39:10.544 INFO:tasks.cephadm:Deploying OSDs... 2024-02-22T18:39:10.545 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:39:10.545 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-02-22T18:39:10.550 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-22T18:39:10.550 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-02-22T18:39:10.556 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-22T18:39:10.556 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T18:39:10.556 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 358 Links: 1 2024-02-22T18:39:10.556 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T18:39:10.556 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-02-22 18:34:41.530197513 +0000 2024-02-22T18:39:10.556 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-02-22 18:34:41.526197606 +0000 2024-02-22T18:39:10.556 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-02-22 18:34:41.526197606 +0000 2024-02-22T18:39:10.556 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-02-22T18:39:10.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-22T18:39:10.605 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-02-22T18:39:10.605 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-02-22T18:39:10.605 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000281013 s, 1.8 MB/s 2024-02-22T18:39:10.606 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-22T18:39:10.613 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-02-22T18:39:10.619 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-22T18:39:10.619 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T18:39:10.619 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 364 Links: 1 2024-02-22T18:39:10.619 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T18:39:10.619 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-02-22 18:34:42.190182329 +0000 2024-02-22T18:39:10.619 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-02-22 18:34:41.978187206 +0000 2024-02-22T18:39:10.619 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-02-22 18:34:41.978187206 +0000 2024-02-22T18:39:10.619 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-02-22T18:39:10.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-22T18:39:10.629 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-02-22T18:39:10.629 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-02-22T18:39:10.629 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000414669 s, 1.2 MB/s 2024-02-22T18:39:10.630 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-22T18:39:10.682 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-02-22T18:39:10.689 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-22T18:39:10.689 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T18:39:10.689 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 370 Links: 1 2024-02-22T18:39:10.689 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T18:39:10.689 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-02-22 18:34:42.634172115 +0000 2024-02-22T18:39:10.689 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-02-22 18:34:42.410177267 +0000 2024-02-22T18:39:10.690 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-02-22 18:34:42.410177267 +0000 2024-02-22T18:39:10.690 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-02-22T18:39:10.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-22T18:39:10.698 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-02-22T18:39:10.698 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-02-22T18:39:10.698 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000409205 s, 1.3 MB/s 2024-02-22T18:39:10.699 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-22T18:39:10.707 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-02-22T18:39:10.742 INFO:journalctl@ceph.mgr.x.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:39:10.756 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-22T18:39:10.756 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T18:39:10.756 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-02-22T18:39:10.756 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T18:39:10.756 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-02-22 18:34:42.866166776 +0000 2024-02-22T18:39:10.757 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-02-22 18:34:42.862166869 +0000 2024-02-22T18:39:10.757 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-02-22 18:34:42.862166869 +0000 2024-02-22T18:39:10.757 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-02-22T18:39:10.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-22T18:39:10.770 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-02-22T18:39:10.770 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-02-22T18:39:10.770 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.0003485 s, 1.5 MB/s 2024-02-22T18:39:10.771 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-22T18:39:10.779 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-22T18:39:10.779 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-02-22T18:39:10.786 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-22T18:39:10.787 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-02-22T18:39:10.837 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-22T18:39:10.837 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T18:39:10.837 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-02-22T18:39:10.837 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T18:39:10.837 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-02-22 18:34:36.097442827 +0000 2024-02-22T18:39:10.837 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-02-22 18:34:36.093442919 +0000 2024-02-22T18:39:10.837 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-02-22 18:34:36.093442919 +0000 2024-02-22T18:39:10.837 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-02-22T18:39:10.838 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-22T18:39:10.848 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-02-22T18:39:10.848 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-02-22T18:39:10.848 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000417124 s, 1.2 MB/s 2024-02-22T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-22T18:39:10.856 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-02-22T18:39:10.905 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-22T18:39:10.905 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T18:39:10.905 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 367 Links: 1 2024-02-22T18:39:10.905 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T18:39:10.905 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-02-22 18:34:36.749427827 +0000 2024-02-22T18:39:10.905 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-02-22 18:34:36.565432060 +0000 2024-02-22T18:39:10.905 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-02-22 18:34:36.565432060 +0000 2024-02-22T18:39:10.905 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-02-22T18:39:10.905 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-22T18:39:10.914 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-02-22T18:39:10.914 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-02-22T18:39:10.914 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000278668 s, 1.8 MB/s 2024-02-22T18:39:10.915 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-22T18:39:10.925 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-02-22T18:39:10.931 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-22T18:39:10.931 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T18:39:10.931 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-02-22T18:39:10.931 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T18:39:10.931 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-02-22 18:34:37.201417427 +0000 2024-02-22T18:39:10.931 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-02-22 18:34:36.989422305 +0000 2024-02-22T18:39:10.932 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-02-22 18:34:36.989422305 +0000 2024-02-22T18:39:10.932 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-02-22T18:39:10.932 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-22T18:39:10.989 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-02-22T18:39:10.990 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-02-22T18:39:10.990 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000370856 s, 1.4 MB/s 2024-02-22T18:39:10.991 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-22T18:39:10.998 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-02-22T18:39:11.005 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-22T18:39:11.005 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T18:39:11.005 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-02-22T18:39:11.005 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T18:39:11.005 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-02-22 18:34:37.653407029 +0000 2024-02-22T18:39:11.005 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-02-22 18:34:37.433412090 +0000 2024-02-22T18:39:11.005 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-02-22 18:34:37.433412090 +0000 2024-02-22T18:39:11.005 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-02-22T18:39:11.005 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-22T18:39:11.017 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-02-22T18:39:11.017 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-02-22T18:39:11.017 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.00029536 s, 1.7 MB/s 2024-02-22T18:39:11.018 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-22T18:39:11.026 INFO:tasks.cephadm:Deploying osd.0 on smithi040 with /dev/vg_nvme/lv_4... 2024-02-22T18:39:11.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:09.975003+0000 mgr.y (mgr.14138) 59 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi040=y;smithi111=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: cephadm 2024-02-22T18:39:09.976641+0000 mgr.y (mgr.14138) 60 : cephadm [INF] Saving service mgr spec with placement smithi040=y;smithi111=x;count:2 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:09.982298+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:09.985148+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: cluster 2024-02-22T18:39:10.534157+0000 mgr.y (mgr.14138) 61 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:10.602231+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:10.608374+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:10.609951+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:10.613826+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:10.614992+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:10.616346+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:11.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:10 smithi111 bash[14162]: audit 2024-02-22T18:39:10.617905+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:09.975003+0000 mgr.y (mgr.14138) 59 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi040=y;smithi111=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: cephadm 2024-02-22T18:39:09.976641+0000 mgr.y (mgr.14138) 60 : cephadm [INF] Saving service mgr spec with placement smithi040=y;smithi111=x;count:2 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:09.982298+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:09.985148+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: cluster 2024-02-22T18:39:10.534157+0000 mgr.y (mgr.14138) 61 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:10.602231+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:10.608374+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:10.609951+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:10.613826+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:10.614992+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:10.616346+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:11.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[13988]: audit 2024-02-22T18:39:10.617905+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:09.975003+0000 mgr.y (mgr.14138) 59 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi040=y;smithi111=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: cephadm 2024-02-22T18:39:09.976641+0000 mgr.y (mgr.14138) 60 : cephadm [INF] Saving service mgr spec with placement smithi040=y;smithi111=x;count:2 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:09.982298+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:09.985148+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: cluster 2024-02-22T18:39:10.534157+0000 mgr.y (mgr.14138) 61 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:10.602231+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:10.608374+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:10.609951+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:10.613826+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:10.614992+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:10.616346+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:11.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:10 smithi040 bash[17964]: audit 2024-02-22T18:39:10.617905+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T18:39:12.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:12 smithi040 bash[13988]: cephadm 2024-02-22T18:39:10.617322+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Deploying daemon mgr.x on smithi111 2024-02-22T18:39:12.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:12 smithi040 bash[17964]: cephadm 2024-02-22T18:39:10.617322+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Deploying daemon mgr.x on smithi111 2024-02-22T18:39:12.885 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:12 smithi111 bash[14162]: cephadm 2024-02-22T18:39:10.617322+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Deploying daemon mgr.x on smithi111 2024-02-22T18:39:13.213 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:39:12 smithi111 systemd[1]: Started Ceph mgr.x for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:39:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:13 smithi040 bash[17964]: cluster 2024-02-22T18:39:12.534631+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:13 smithi040 bash[17964]: audit 2024-02-22T18:39:12.913738+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:13 smithi040 bash[17964]: audit 2024-02-22T18:39:12.916252+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:13 smithi040 bash[13988]: cluster 2024-02-22T18:39:12.534631+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:13 smithi040 bash[13988]: audit 2024-02-22T18:39:12.913738+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:13.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:13 smithi040 bash[13988]: audit 2024-02-22T18:39:12.916252+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:13.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:13 smithi111 bash[14162]: cluster 2024-02-22T18:39:12.534631+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:13.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:13 smithi111 bash[14162]: audit 2024-02-22T18:39:12.913738+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:13.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:13 smithi111 bash[14162]: audit 2024-02-22T18:39:12.916252+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:14.171 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-22T18:39:14.171 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-22T18:39:14.171 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-02-22T18:39:14.171 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-02-22T18:39:14.171 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.017687 s, 593 MB/s 2024-02-22T18:39:14.171 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-02-22T18:39:15.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[13988]: audit 2024-02-22T18:39:13.781305+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:15.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[13988]: audit 2024-02-22T18:39:13.787570+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:15.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[13988]: cephadm 2024-02-22T18:39:13.788518+0000 mgr.y (mgr.14138) 64 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[13988]: audit 2024-02-22T18:39:13.789943+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[13988]: audit 2024-02-22T18:39:13.791412+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[13988]: cephadm 2024-02-22T18:39:13.792413+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[13988]: audit 2024-02-22T18:39:13.793119+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[13988]: cluster 2024-02-22T18:39:14.535130+0000 mgr.y (mgr.14138) 66 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[17964]: audit 2024-02-22T18:39:13.781305+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[17964]: audit 2024-02-22T18:39:13.787570+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[17964]: cephadm 2024-02-22T18:39:13.788518+0000 mgr.y (mgr.14138) 64 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[17964]: audit 2024-02-22T18:39:13.789943+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[17964]: audit 2024-02-22T18:39:13.791412+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[17964]: cephadm 2024-02-22T18:39:13.792413+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[17964]: audit 2024-02-22T18:39:13.793119+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2024-02-22T18:39:15.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:14 smithi040 bash[17964]: cluster 2024-02-22T18:39:14.535130+0000 mgr.y (mgr.14138) 66 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:15.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:14 smithi111 bash[14162]: audit 2024-02-22T18:39:13.781305+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:15.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:14 smithi111 bash[14162]: audit 2024-02-22T18:39:13.787570+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:15.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:14 smithi111 bash[14162]: cephadm 2024-02-22T18:39:13.788518+0000 mgr.y (mgr.14138) 64 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-22T18:39:15.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:14 smithi111 bash[14162]: audit 2024-02-22T18:39:13.789943+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:39:15.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:14 smithi111 bash[14162]: audit 2024-02-22T18:39:13.791412+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:15.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:14 smithi111 bash[14162]: cephadm 2024-02-22T18:39:13.792413+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-22T18:39:15.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:14 smithi111 bash[14162]: audit 2024-02-22T18:39:13.793119+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2024-02-22T18:39:15.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:14 smithi111 bash[14162]: cluster 2024-02-22T18:39:14.535130+0000 mgr.y (mgr.14138) 66 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:15.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_4 2024-02-22T18:39:17.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[13988]: cluster 2024-02-22T18:39:16.535577+0000 mgr.y (mgr.14138) 67 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:17.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[13988]: audit 2024-02-22T18:39:16.979773+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:17.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[13988]: audit 2024-02-22T18:39:16.980895+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-22T18:39:17.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[13988]: audit 2024-02-22T18:39:16.982231+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:17.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[13988]: audit 2024-02-22T18:39:16.983888+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-22T18:39:17.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[17964]: cluster 2024-02-22T18:39:16.535577+0000 mgr.y (mgr.14138) 67 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:17.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[17964]: audit 2024-02-22T18:39:16.979773+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:17.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[17964]: audit 2024-02-22T18:39:16.980895+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-22T18:39:17.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[17964]: audit 2024-02-22T18:39:16.982231+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:17.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:17 smithi040 bash[17964]: audit 2024-02-22T18:39:16.983888+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-22T18:39:17.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:17 smithi111 bash[14162]: cluster 2024-02-22T18:39:16.535577+0000 mgr.y (mgr.14138) 67 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:17.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:17 smithi111 bash[14162]: audit 2024-02-22T18:39:16.979773+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:17.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:17 smithi111 bash[14162]: audit 2024-02-22T18:39:16.980895+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-22T18:39:17.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:17 smithi111 bash[14162]: audit 2024-02-22T18:39:16.982231+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:17.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:17 smithi111 bash[14162]: audit 2024-02-22T18:39:16.983888+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-22T18:39:18.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[13988]: cephadm 2024-02-22T18:39:16.980435+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-22T18:39:18.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[13988]: cephadm 2024-02-22T18:39:16.983251+0000 mgr.y (mgr.14138) 69 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-22T18:39:18.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[13988]: cluster 2024-02-22T18:39:17.992370+0000 mon.a (mon.0) 230 : cluster [DBG] Standby manager daemon x started 2024-02-22T18:39:18.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[13988]: audit 2024-02-22T18:39:17.995720+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.111:0/2344689674' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:39:18.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[13988]: audit 2024-02-22T18:39:17.997760+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.111:0/2344689674' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:39:18.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[17964]: cephadm 2024-02-22T18:39:16.980435+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-22T18:39:18.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[17964]: cephadm 2024-02-22T18:39:16.983251+0000 mgr.y (mgr.14138) 69 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-22T18:39:18.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[17964]: cluster 2024-02-22T18:39:17.992370+0000 mon.a (mon.0) 230 : cluster [DBG] Standby manager daemon x started 2024-02-22T18:39:18.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[17964]: audit 2024-02-22T18:39:17.995720+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.111:0/2344689674' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:39:18.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:18 smithi040 bash[17964]: audit 2024-02-22T18:39:17.997760+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.111:0/2344689674' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:39:18.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:18 smithi111 bash[14162]: cephadm 2024-02-22T18:39:16.980435+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-22T18:39:18.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:18 smithi111 bash[14162]: cephadm 2024-02-22T18:39:16.983251+0000 mgr.y (mgr.14138) 69 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-22T18:39:18.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:18 smithi111 bash[14162]: cluster 2024-02-22T18:39:17.992370+0000 mon.a (mon.0) 230 : cluster [DBG] Standby manager daemon x started 2024-02-22T18:39:18.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:18 smithi111 bash[14162]: audit 2024-02-22T18:39:17.995720+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.111:0/2344689674' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:39:18.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:18 smithi111 bash[14162]: audit 2024-02-22T18:39:17.997760+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.111:0/2344689674' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:39:19.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[13988]: cluster 2024-02-22T18:39:18.536076+0000 mgr.y (mgr.14138) 70 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[13988]: cluster 2024-02-22T18:39:18.551192+0000 mon.a (mon.0) 231 : cluster [DBG] mgrmap e14: y(active, since 96s), standbys: x 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[13988]: audit 2024-02-22T18:39:18.551343+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[13988]: audit 2024-02-22T18:39:19.470580+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[13988]: audit 2024-02-22T18:39:19.474705+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[13988]: audit 2024-02-22T18:39:19.476221+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[13988]: audit 2024-02-22T18:39:19.478071+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[17964]: cluster 2024-02-22T18:39:18.536076+0000 mgr.y (mgr.14138) 70 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[17964]: cluster 2024-02-22T18:39:18.551192+0000 mon.a (mon.0) 231 : cluster [DBG] mgrmap e14: y(active, since 96s), standbys: x 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[17964]: audit 2024-02-22T18:39:18.551343+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[17964]: audit 2024-02-22T18:39:19.470580+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[17964]: audit 2024-02-22T18:39:19.474705+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:39:19.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[17964]: audit 2024-02-22T18:39:19.476221+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:19.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:19 smithi040 bash[17964]: audit 2024-02-22T18:39:19.478071+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:19.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:19 smithi111 bash[14162]: cluster 2024-02-22T18:39:18.536076+0000 mgr.y (mgr.14138) 70 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:19.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:19 smithi111 bash[14162]: cluster 2024-02-22T18:39:18.551192+0000 mon.a (mon.0) 231 : cluster [DBG] mgrmap e14: y(active, since 96s), standbys: x 2024-02-22T18:39:19.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:19 smithi111 bash[14162]: audit 2024-02-22T18:39:18.551343+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T18:39:19.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:19 smithi111 bash[14162]: audit 2024-02-22T18:39:19.470580+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:39:19.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:19 smithi111 bash[14162]: audit 2024-02-22T18:39:19.474705+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:39:19.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:19 smithi111 bash[14162]: audit 2024-02-22T18:39:19.476221+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:19.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:19 smithi111 bash[14162]: audit 2024-02-22T18:39:19.478071+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:20.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[13988]: audit 2024-02-22T18:39:19.468730+0000 mgr.y (mgr.14138) 71 : audit [DBG] from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[13988]: cephadm 2024-02-22T18:39:19.474229+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[13988]: audit 2024-02-22T18:39:20.080330+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[13988]: audit 2024-02-22T18:39:20.081801+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[13988]: audit 2024-02-22T18:39:20.083417+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[13988]: audit 2024-02-22T18:39:20.085134+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[17964]: audit 2024-02-22T18:39:19.468730+0000 mgr.y (mgr.14138) 71 : audit [DBG] from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[17964]: cephadm 2024-02-22T18:39:19.474229+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[17964]: audit 2024-02-22T18:39:20.080330+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[17964]: audit 2024-02-22T18:39:20.081801+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:39:20.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[17964]: audit 2024-02-22T18:39:20.083417+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:20.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:20 smithi040 bash[17964]: audit 2024-02-22T18:39:20.085134+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-02-22T18:39:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:20 smithi111 bash[14162]: audit 2024-02-22T18:39:19.468730+0000 mgr.y (mgr.14138) 71 : audit [DBG] from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:39:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:20 smithi111 bash[14162]: cephadm 2024-02-22T18:39:19.474229+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:39:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:20 smithi111 bash[14162]: audit 2024-02-22T18:39:20.080330+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:20 smithi111 bash[14162]: audit 2024-02-22T18:39:20.081801+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:39:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:20 smithi111 bash[14162]: audit 2024-02-22T18:39:20.083417+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:20 smithi111 bash[14162]: audit 2024-02-22T18:39:20.085134+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-02-22T18:39:21.876 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:21 smithi040 bash[13988]: cephadm 2024-02-22T18:39:20.081365+0000 mgr.y (mgr.14138) 73 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T18:39:21.877 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:21 smithi040 bash[13988]: cephadm 2024-02-22T18:39:20.084619+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-22T18:39:21.877 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:21 smithi040 bash[13988]: cluster 2024-02-22T18:39:20.536567+0000 mgr.y (mgr.14138) 75 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:21.877 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:21 smithi040 bash[17964]: cephadm 2024-02-22T18:39:20.081365+0000 mgr.y (mgr.14138) 73 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T18:39:21.877 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:21 smithi040 bash[17964]: cephadm 2024-02-22T18:39:20.084619+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-22T18:39:21.877 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:21 smithi040 bash[17964]: cluster 2024-02-22T18:39:20.536567+0000 mgr.y (mgr.14138) 75 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:21.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:21 smithi111 bash[14162]: cephadm 2024-02-22T18:39:20.081365+0000 mgr.y (mgr.14138) 73 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T18:39:21.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:21 smithi111 bash[14162]: cephadm 2024-02-22T18:39:20.084619+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-22T18:39:21.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:21 smithi111 bash[14162]: cluster 2024-02-22T18:39:20.536567+0000 mgr.y (mgr.14138) 75 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:23.866 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:23 smithi111 bash[14162]: cluster 2024-02-22T18:39:22.537064+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:23.866 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:23 smithi111 bash[14162]: audit 2024-02-22T18:39:22.861677+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:23.867 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:23 smithi111 bash[14162]: audit 2024-02-22T18:39:22.864162+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:39:23.867 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:23 smithi111 bash[14162]: audit 2024-02-22T18:39:22.865800+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:23.867 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:23 smithi111 bash[14162]: audit 2024-02-22T18:39:22.867787+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-22T18:39:23.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[13988]: cluster 2024-02-22T18:39:22.537064+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:23.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[13988]: audit 2024-02-22T18:39:22.861677+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:23.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[13988]: audit 2024-02-22T18:39:22.864162+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:39:23.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[13988]: audit 2024-02-22T18:39:22.865800+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:23.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[13988]: audit 2024-02-22T18:39:22.867787+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-22T18:39:23.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[17964]: cluster 2024-02-22T18:39:22.537064+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:23.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[17964]: audit 2024-02-22T18:39:22.861677+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:23.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[17964]: audit 2024-02-22T18:39:22.864162+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T18:39:23.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[17964]: audit 2024-02-22T18:39:22.865800+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:23.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:23 smithi040 bash[17964]: audit 2024-02-22T18:39:22.867787+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-22T18:39:24.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[17964]: cephadm 2024-02-22T18:39:22.863718+0000 mgr.y (mgr.14138) 77 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-22T18:39:24.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[17964]: cephadm 2024-02-22T18:39:22.867057+0000 mgr.y (mgr.14138) 78 : cephadm [INF] Reconfiguring daemon mon.b on smithi111 2024-02-22T18:39:24.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[17964]: audit 2024-02-22T18:39:24.420956+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.40:0/2618103405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8a82ec4-54e0-41b7-9aee-587ee3cc94c3"}]: dispatch 2024-02-22T18:39:24.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[17964]: audit 2024-02-22T18:39:24.421483+0000 mon.a (mon.0) 245 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8a82ec4-54e0-41b7-9aee-587ee3cc94c3"}]: dispatch 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[17964]: audit 2024-02-22T18:39:24.432940+0000 mon.a (mon.0) 246 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8a82ec4-54e0-41b7-9aee-587ee3cc94c3"}]': finished 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[17964]: cluster 2024-02-22T18:39:24.433127+0000 mon.a (mon.0) 247 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[17964]: audit 2024-02-22T18:39:24.433327+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[13988]: cephadm 2024-02-22T18:39:22.863718+0000 mgr.y (mgr.14138) 77 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[13988]: cephadm 2024-02-22T18:39:22.867057+0000 mgr.y (mgr.14138) 78 : cephadm [INF] Reconfiguring daemon mon.b on smithi111 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[13988]: audit 2024-02-22T18:39:24.420956+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.40:0/2618103405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8a82ec4-54e0-41b7-9aee-587ee3cc94c3"}]: dispatch 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[13988]: audit 2024-02-22T18:39:24.421483+0000 mon.a (mon.0) 245 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8a82ec4-54e0-41b7-9aee-587ee3cc94c3"}]: dispatch 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[13988]: audit 2024-02-22T18:39:24.432940+0000 mon.a (mon.0) 246 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8a82ec4-54e0-41b7-9aee-587ee3cc94c3"}]': finished 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[13988]: cluster 2024-02-22T18:39:24.433127+0000 mon.a (mon.0) 247 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-22T18:39:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:24 smithi040 bash[13988]: audit 2024-02-22T18:39:24.433327+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:24 smithi111 bash[14162]: cephadm 2024-02-22T18:39:22.863718+0000 mgr.y (mgr.14138) 77 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-22T18:39:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:24 smithi111 bash[14162]: cephadm 2024-02-22T18:39:22.867057+0000 mgr.y (mgr.14138) 78 : cephadm [INF] Reconfiguring daemon mon.b on smithi111 2024-02-22T18:39:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:24 smithi111 bash[14162]: audit 2024-02-22T18:39:24.420956+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.40:0/2618103405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8a82ec4-54e0-41b7-9aee-587ee3cc94c3"}]: dispatch 2024-02-22T18:39:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:24 smithi111 bash[14162]: audit 2024-02-22T18:39:24.421483+0000 mon.a (mon.0) 245 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8a82ec4-54e0-41b7-9aee-587ee3cc94c3"}]: dispatch 2024-02-22T18:39:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:24 smithi111 bash[14162]: audit 2024-02-22T18:39:24.432940+0000 mon.a (mon.0) 246 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8a82ec4-54e0-41b7-9aee-587ee3cc94c3"}]': finished 2024-02-22T18:39:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:24 smithi111 bash[14162]: cluster 2024-02-22T18:39:24.433127+0000 mon.a (mon.0) 247 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-22T18:39:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:24 smithi111 bash[14162]: audit 2024-02-22T18:39:24.433327+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[13988]: cluster 2024-02-22T18:39:24.537619+0000 mgr.y (mgr.14138) 79 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[13988]: audit 2024-02-22T18:39:24.672987+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[13988]: audit 2024-02-22T18:39:24.675051+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[13988]: audit 2024-02-22T18:39:24.675667+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[13988]: audit 2024-02-22T18:39:25.024961+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.40:0/3303089851' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[13988]: audit 2024-02-22T18:39:25.220001+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[13988]: audit 2024-02-22T18:39:25.230037+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[13988]: audit 2024-02-22T18:39:25.238253+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[17964]: cluster 2024-02-22T18:39:24.537619+0000 mgr.y (mgr.14138) 79 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[17964]: audit 2024-02-22T18:39:24.672987+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[17964]: audit 2024-02-22T18:39:24.675051+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[17964]: audit 2024-02-22T18:39:24.675667+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:25.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[17964]: audit 2024-02-22T18:39:25.024961+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.40:0/3303089851' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:39:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[17964]: audit 2024-02-22T18:39:25.220001+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[17964]: audit 2024-02-22T18:39:25.230037+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:25 smithi040 bash[17964]: audit 2024-02-22T18:39:25.238253+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:25 smithi111 bash[14162]: cluster 2024-02-22T18:39:24.537619+0000 mgr.y (mgr.14138) 79 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:25 smithi111 bash[14162]: audit 2024-02-22T18:39:24.672987+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:25 smithi111 bash[14162]: audit 2024-02-22T18:39:24.675051+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:25 smithi111 bash[14162]: audit 2024-02-22T18:39:24.675667+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:25 smithi111 bash[14162]: audit 2024-02-22T18:39:25.024961+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.40:0/3303089851' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:39:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:25 smithi111 bash[14162]: audit 2024-02-22T18:39:25.220001+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:25 smithi111 bash[14162]: audit 2024-02-22T18:39:25.230037+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:25 smithi111 bash[14162]: audit 2024-02-22T18:39:25.238253+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:27.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:27 smithi040 bash[13988]: cluster 2024-02-22T18:39:26.538123+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:27.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:27 smithi040 bash[17964]: cluster 2024-02-22T18:39:26.538123+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:27 smithi111 bash[14162]: cluster 2024-02-22T18:39:26.538123+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:28.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:28 smithi040 bash[13988]: audit 2024-02-22T18:39:27.836542+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:28.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:28 smithi040 bash[17964]: audit 2024-02-22T18:39:27.836542+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:28.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:28 smithi111 bash[14162]: audit 2024-02-22T18:39:27.836542+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:29.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:29 smithi040 bash[13988]: cluster 2024-02-22T18:39:28.538717+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:29.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:29 smithi040 bash[17964]: cluster 2024-02-22T18:39:28.538717+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:29.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:29 smithi111 bash[14162]: cluster 2024-02-22T18:39:28.538717+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:31.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:31 smithi040 bash[13988]: cluster 2024-02-22T18:39:30.539348+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:31.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:31 smithi040 bash[17964]: cluster 2024-02-22T18:39:30.539348+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:31.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:31 smithi111 bash[14162]: cluster 2024-02-22T18:39:30.539348+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:32.836 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:32 smithi040 bash[13988]: audit 2024-02-22T18:39:31.714577+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T18:39:32.836 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:32 smithi040 bash[13988]: audit 2024-02-22T18:39:31.715856+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:32.836 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:32 smithi040 bash[13988]: audit 2024-02-22T18:39:31.717260+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-22T18:39:32.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:32 smithi040 bash[17964]: audit 2024-02-22T18:39:31.714577+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T18:39:32.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:32 smithi040 bash[17964]: audit 2024-02-22T18:39:31.715856+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:32.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:32 smithi040 bash[17964]: audit 2024-02-22T18:39:31.717260+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-22T18:39:32.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:32 smithi111 bash[14162]: audit 2024-02-22T18:39:31.714577+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T18:39:32.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:32 smithi111 bash[14162]: audit 2024-02-22T18:39:31.715856+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:32.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:32 smithi111 bash[14162]: audit 2024-02-22T18:39:31.717260+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-22T18:39:33.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:33 smithi040 bash[13988]: cephadm 2024-02-22T18:39:31.716814+0000 mgr.y (mgr.14138) 83 : cephadm [INF] Deploying daemon osd.0 on smithi040 2024-02-22T18:39:33.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:33 smithi040 bash[13988]: cluster 2024-02-22T18:39:32.539989+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:33.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:33 smithi040 bash[17964]: cephadm 2024-02-22T18:39:31.716814+0000 mgr.y (mgr.14138) 83 : cephadm [INF] Deploying daemon osd.0 on smithi040 2024-02-22T18:39:33.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:33 smithi040 bash[17964]: cluster 2024-02-22T18:39:32.539989+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:33.957 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 0 on host 'smithi040' 2024-02-22T18:39:33.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:33 smithi111 bash[14162]: cephadm 2024-02-22T18:39:31.716814+0000 mgr.y (mgr.14138) 83 : cephadm [INF] Deploying daemon osd.0 on smithi040 2024-02-22T18:39:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:33 smithi111 bash[14162]: cluster 2024-02-22T18:39:32.539989+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:34.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:34 smithi040 bash[13988]: audit 2024-02-22T18:39:33.946118+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:34.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:34 smithi040 bash[13988]: audit 2024-02-22T18:39:33.949775+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:34.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:34 smithi040 bash[17964]: audit 2024-02-22T18:39:33.946118+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:34.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:34 smithi040 bash[17964]: audit 2024-02-22T18:39:33.949775+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:34.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:34 smithi111 bash[14162]: audit 2024-02-22T18:39:33.946118+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:34.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:34 smithi111 bash[14162]: audit 2024-02-22T18:39:33.949775+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:35.716 DEBUG:teuthology.orchestra.run.smithi040:osd.0> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.0.service 2024-02-22T18:39:35.718 INFO:tasks.cephadm:Deploying osd.1 on smithi040 with /dev/vg_nvme/lv_3... 2024-02-22T18:39:35.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-22T18:39:35.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:35 smithi040 bash[13988]: cephadm 2024-02-22T18:39:33.945733+0000 mgr.y (mgr.14138) 85 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:39:35.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:35 smithi040 bash[13988]: cluster 2024-02-22T18:39:34.540415+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:35.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:35 smithi040 bash[13988]: audit 2024-02-22T18:39:34.870596+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:35.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:35 smithi040 bash[13988]: audit 2024-02-22T18:39:34.871895+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:35.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:35 smithi040 bash[17964]: cephadm 2024-02-22T18:39:33.945733+0000 mgr.y (mgr.14138) 85 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:39:35.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:35 smithi040 bash[17964]: cluster 2024-02-22T18:39:34.540415+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:35.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:35 smithi040 bash[17964]: audit 2024-02-22T18:39:34.870596+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:35.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:35 smithi040 bash[17964]: audit 2024-02-22T18:39:34.871895+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:35 smithi111 bash[14162]: cephadm 2024-02-22T18:39:33.945733+0000 mgr.y (mgr.14138) 85 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:39:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:35 smithi111 bash[14162]: cluster 2024-02-22T18:39:34.540415+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:35 smithi111 bash[14162]: audit 2024-02-22T18:39:34.870596+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:35 smithi111 bash[14162]: audit 2024-02-22T18:39:34.871895+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:37.374 INFO:journalctl@ceph.osd.0.smithi040.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:39:37.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:37 smithi040 bash[13988]: cluster 2024-02-22T18:39:36.540872+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:37.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:37 smithi040 bash[17964]: cluster 2024-02-22T18:39:36.540872+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:37.832 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:37 smithi040 bash[20331]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-22T18:39:37.832 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:37 smithi040 bash[20331]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-02-22T18:39:37.832 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:37 smithi040 bash[20331]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-22T18:39:37.833 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:37 smithi040 bash[20331]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-02-22T18:39:37.833 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:37 smithi040 bash[20331]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-22T18:39:37.833 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:37 smithi040 bash[20331]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-22T18:39:37.833 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:37 smithi040 bash[20331]: --> ceph-volume lvm activate successful for osd ID: 0 2024-02-22T18:39:37.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:37 smithi111 bash[14162]: cluster 2024-02-22T18:39:36.540872+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:38.795 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:38 smithi040 bash[13988]: cluster 2024-02-22T18:39:37.533550+0000 mon.a (mon.0) 263 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T18:39:38.795 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:38 smithi040 bash[17964]: cluster 2024-02-22T18:39:37.533550+0000 mon.a (mon.0) 263 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T18:39:38.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:38 smithi111 bash[14162]: cluster 2024-02-22T18:39:37.533550+0000 mon.a (mon.0) 263 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T18:39:39.724 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:39 smithi040 bash[17964]: cluster 2024-02-22T18:39:38.541407+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:39.725 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:39 smithi040 bash[13988]: cluster 2024-02-22T18:39:38.541407+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:39.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:39 smithi111 bash[14162]: cluster 2024-02-22T18:39:38.541407+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:41.747 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-22T18:39:41.747 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-22T18:39:41.747 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-02-22T18:39:41.747 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-02-22T18:39:41.748 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0158827 s, 660 MB/s 2024-02-22T18:39:41.748 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-02-22T18:39:41.813 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:41 smithi040 bash[13988]: cluster 2024-02-22T18:39:40.541961+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:41.813 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:41 smithi040 bash[17964]: cluster 2024-02-22T18:39:40.541961+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:41.813 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:41 smithi040 bash[20705]: debug 2024-02-22T18:39:41.540+0000 7fba712b4f40 -1 Falling back to public interface 2024-02-22T18:39:41.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:41 smithi111 bash[14162]: cluster 2024-02-22T18:39:40.541961+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:42.178 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:41 smithi040 bash[20705]: debug 2024-02-22T18:39:41.920+0000 7fba712b4f40 -1 osd.0 0 log_to_monitors {default=true} 2024-02-22T18:39:42.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_3 2024-02-22T18:39:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:42 smithi040 bash[13988]: audit 2024-02-22T18:39:41.929546+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2441240869,v1:172.21.15.40:6803/2441240869]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T18:39:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:42 smithi040 bash[13988]: audit 2024-02-22T18:39:41.930125+0000 mon.a (mon.0) 264 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T18:39:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:42 smithi040 bash[17964]: audit 2024-02-22T18:39:41.929546+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2441240869,v1:172.21.15.40:6803/2441240869]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T18:39:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:42 smithi040 bash[17964]: audit 2024-02-22T18:39:41.930125+0000 mon.a (mon.0) 264 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T18:39:42.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:42 smithi111 bash[14162]: audit 2024-02-22T18:39:41.929546+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2441240869,v1:172.21.15.40:6803/2441240869]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T18:39:42.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:42 smithi111 bash[14162]: audit 2024-02-22T18:39:41.930125+0000 mon.a (mon.0) 264 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T18:39:43.829 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[20705]: debug 2024-02-22T18:39:43.568+0000 7fba55d82700 -1 osd.0 0 waiting for initial osdmap 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[17964]: cluster 2024-02-22T18:39:42.542534+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[17964]: audit 2024-02-22T18:39:42.561339+0000 mon.a (mon.0) 265 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[17964]: cluster 2024-02-22T18:39:42.561465+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[17964]: audit 2024-02-22T18:39:42.561797+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[17964]: audit 2024-02-22T18:39:42.564807+0000 mon.c (mon.1) 7 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2441240869,v1:172.21.15.40:6803/2441240869]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[17964]: audit 2024-02-22T18:39:42.565195+0000 mon.a (mon.0) 268 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[17964]: audit 2024-02-22T18:39:42.725331+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[17964]: audit 2024-02-22T18:39:42.727495+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[13988]: cluster 2024-02-22T18:39:42.542534+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[13988]: audit 2024-02-22T18:39:42.561339+0000 mon.a (mon.0) 265 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[13988]: cluster 2024-02-22T18:39:42.561465+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-22T18:39:43.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[13988]: audit 2024-02-22T18:39:42.561797+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:43.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[13988]: audit 2024-02-22T18:39:42.564807+0000 mon.c (mon.1) 7 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2441240869,v1:172.21.15.40:6803/2441240869]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:39:43.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[13988]: audit 2024-02-22T18:39:42.565195+0000 mon.a (mon.0) 268 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:39:43.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[13988]: audit 2024-02-22T18:39:42.725331+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:39:43.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:43 smithi040 bash[13988]: audit 2024-02-22T18:39:42.727495+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:39:43.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:43 smithi111 bash[14162]: cluster 2024-02-22T18:39:42.542534+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:43 smithi111 bash[14162]: audit 2024-02-22T18:39:42.561339+0000 mon.a (mon.0) 265 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T18:39:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:43 smithi111 bash[14162]: cluster 2024-02-22T18:39:42.561465+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-22T18:39:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:43 smithi111 bash[14162]: audit 2024-02-22T18:39:42.561797+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:43 smithi111 bash[14162]: audit 2024-02-22T18:39:42.564807+0000 mon.c (mon.1) 7 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2441240869,v1:172.21.15.40:6803/2441240869]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:39:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:43 smithi111 bash[14162]: audit 2024-02-22T18:39:42.565195+0000 mon.a (mon.0) 268 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:39:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:43 smithi111 bash[14162]: audit 2024-02-22T18:39:42.725331+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:39:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:43 smithi111 bash[14162]: audit 2024-02-22T18:39:42.727495+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:39:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[17964]: audit 2024-02-22T18:39:43.565263+0000 mon.a (mon.0) 271 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:39:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[17964]: cluster 2024-02-22T18:39:43.565664+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-22T18:39:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[17964]: audit 2024-02-22T18:39:43.566743+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[17964]: audit 2024-02-22T18:39:43.576387+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[17964]: audit 2024-02-22T18:39:43.678029+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[17964]: audit 2024-02-22T18:39:43.995341+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[17964]: audit 2024-02-22T18:39:44.002167+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[17964]: audit 2024-02-22T18:39:44.004216+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[13988]: audit 2024-02-22T18:39:43.565263+0000 mon.a (mon.0) 271 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:39:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[13988]: cluster 2024-02-22T18:39:43.565664+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-22T18:39:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[13988]: audit 2024-02-22T18:39:43.566743+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[13988]: audit 2024-02-22T18:39:43.576387+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[13988]: audit 2024-02-22T18:39:43.678029+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[13988]: audit 2024-02-22T18:39:43.995341+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[13988]: audit 2024-02-22T18:39:44.002167+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:44 smithi040 bash[13988]: audit 2024-02-22T18:39:44.004216+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:44.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:44 smithi111 bash[14162]: audit 2024-02-22T18:39:43.565263+0000 mon.a (mon.0) 271 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:39:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:44 smithi111 bash[14162]: cluster 2024-02-22T18:39:43.565664+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-22T18:39:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:44 smithi111 bash[14162]: audit 2024-02-22T18:39:43.566743+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:44 smithi111 bash[14162]: audit 2024-02-22T18:39:43.576387+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:44 smithi111 bash[14162]: audit 2024-02-22T18:39:43.678029+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:44 smithi111 bash[14162]: audit 2024-02-22T18:39:43.995341+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:44 smithi111 bash[14162]: audit 2024-02-22T18:39:44.002167+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:44 smithi111 bash[14162]: audit 2024-02-22T18:39:44.004216+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:45.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[13988]: cluster 2024-02-22T18:39:42.920327+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:39:45.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[13988]: cluster 2024-02-22T18:39:42.920418+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:39:45.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[13988]: cluster 2024-02-22T18:39:44.543090+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:45.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[13988]: cluster 2024-02-22T18:39:44.576498+0000 mon.a (mon.0) 279 : cluster [INF] osd.0 [v2:172.21.15.40:6802/2441240869,v1:172.21.15.40:6803/2441240869] boot 2024-02-22T18:39:45.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[13988]: cluster 2024-02-22T18:39:44.576626+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-22T18:39:45.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[13988]: audit 2024-02-22T18:39:44.577252+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:45.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[13988]: audit 2024-02-22T18:39:44.745264+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:45.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[13988]: audit 2024-02-22T18:39:44.751825+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:45.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[17964]: cluster 2024-02-22T18:39:42.920327+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:39:45.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[17964]: cluster 2024-02-22T18:39:42.920418+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:39:45.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[17964]: cluster 2024-02-22T18:39:44.543090+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:45.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[17964]: cluster 2024-02-22T18:39:44.576498+0000 mon.a (mon.0) 279 : cluster [INF] osd.0 [v2:172.21.15.40:6802/2441240869,v1:172.21.15.40:6803/2441240869] boot 2024-02-22T18:39:45.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[17964]: cluster 2024-02-22T18:39:44.576626+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-22T18:39:45.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[17964]: audit 2024-02-22T18:39:44.577252+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:45.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[17964]: audit 2024-02-22T18:39:44.745264+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:45.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:45 smithi040 bash[17964]: audit 2024-02-22T18:39:44.751825+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:45.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:45 smithi111 bash[14162]: cluster 2024-02-22T18:39:42.920327+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:39:45.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:45 smithi111 bash[14162]: cluster 2024-02-22T18:39:42.920418+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:39:45.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:45 smithi111 bash[14162]: cluster 2024-02-22T18:39:44.543090+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T18:39:45.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:45 smithi111 bash[14162]: cluster 2024-02-22T18:39:44.576498+0000 mon.a (mon.0) 279 : cluster [INF] osd.0 [v2:172.21.15.40:6802/2441240869,v1:172.21.15.40:6803/2441240869] boot 2024-02-22T18:39:45.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:45 smithi111 bash[14162]: cluster 2024-02-22T18:39:44.576626+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-22T18:39:45.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:45 smithi111 bash[14162]: audit 2024-02-22T18:39:44.577252+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:39:45.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:45 smithi111 bash[14162]: audit 2024-02-22T18:39:44.745264+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:45.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:45 smithi111 bash[14162]: audit 2024-02-22T18:39:44.751825+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:46.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[13988]: cluster 2024-02-22T18:39:45.578432+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-22T18:39:46.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[13988]: audit 2024-02-22T18:39:45.787223+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:39:46.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[13988]: audit 2024-02-22T18:39:45.789416+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:39:46.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[13988]: audit 2024-02-22T18:39:45.790654+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:46.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[13988]: audit 2024-02-22T18:39:45.792086+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:46.883 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[17964]: cluster 2024-02-22T18:39:45.578432+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-22T18:39:46.883 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[17964]: audit 2024-02-22T18:39:45.787223+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:39:46.883 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[17964]: audit 2024-02-22T18:39:45.789416+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:39:46.884 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[17964]: audit 2024-02-22T18:39:45.790654+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:46.884 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:46 smithi040 bash[17964]: audit 2024-02-22T18:39:45.792086+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:46.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:46 smithi111 bash[14162]: cluster 2024-02-22T18:39:45.578432+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-22T18:39:46.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:46 smithi111 bash[14162]: audit 2024-02-22T18:39:45.787223+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:39:46.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:46 smithi111 bash[14162]: audit 2024-02-22T18:39:45.789416+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:39:46.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:46 smithi111 bash[14162]: audit 2024-02-22T18:39:45.790654+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:46.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:46 smithi111 bash[14162]: audit 2024-02-22T18:39:45.792086+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:47.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[13988]: audit 2024-02-22T18:39:45.785530+0000 mgr.y (mgr.14138) 92 : audit [DBG] from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:39:47.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[13988]: cephadm 2024-02-22T18:39:45.789085+0000 mgr.y (mgr.14138) 93 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:39:47.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[13988]: cluster 2024-02-22T18:39:46.543719+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v63: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:47.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[13988]: cluster 2024-02-22T18:39:46.580756+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-22T18:39:47.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[13988]: cluster 2024-02-22T18:39:47.536489+0000 mon.a (mon.0) 290 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T18:39:47.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[17964]: audit 2024-02-22T18:39:45.785530+0000 mgr.y (mgr.14138) 92 : audit [DBG] from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:39:47.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[17964]: cephadm 2024-02-22T18:39:45.789085+0000 mgr.y (mgr.14138) 93 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:39:47.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[17964]: cluster 2024-02-22T18:39:46.543719+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v63: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:47.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[17964]: cluster 2024-02-22T18:39:46.580756+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-22T18:39:47.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:47 smithi040 bash[17964]: cluster 2024-02-22T18:39:47.536489+0000 mon.a (mon.0) 290 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T18:39:47.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:47 smithi111 bash[14162]: audit 2024-02-22T18:39:45.785530+0000 mgr.y (mgr.14138) 92 : audit [DBG] from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:39:47.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:47 smithi111 bash[14162]: cephadm 2024-02-22T18:39:45.789085+0000 mgr.y (mgr.14138) 93 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:39:47.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:47 smithi111 bash[14162]: cluster 2024-02-22T18:39:46.543719+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v63: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:47.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:47 smithi111 bash[14162]: cluster 2024-02-22T18:39:46.580756+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-22T18:39:47.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:47 smithi111 bash[14162]: cluster 2024-02-22T18:39:47.536489+0000 mon.a (mon.0) 290 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T18:39:49.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[13988]: cluster 2024-02-22T18:39:48.544453+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v65: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:49.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[13988]: audit 2024-02-22T18:39:49.066402+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.15.40:0/3014381799' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad58d21e-9da6-4d9d-92e6-30140338e2f6"}]: dispatch 2024-02-22T18:39:49.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[13988]: audit 2024-02-22T18:39:49.067312+0000 mon.a (mon.0) 291 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad58d21e-9da6-4d9d-92e6-30140338e2f6"}]: dispatch 2024-02-22T18:39:49.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[13988]: audit 2024-02-22T18:39:49.076566+0000 mon.a (mon.0) 292 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad58d21e-9da6-4d9d-92e6-30140338e2f6"}]': finished 2024-02-22T18:39:49.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[13988]: cluster 2024-02-22T18:39:49.076723+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-22T18:39:49.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[13988]: audit 2024-02-22T18:39:49.076972+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:39:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[17964]: cluster 2024-02-22T18:39:48.544453+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v65: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[17964]: audit 2024-02-22T18:39:49.066402+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.15.40:0/3014381799' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad58d21e-9da6-4d9d-92e6-30140338e2f6"}]: dispatch 2024-02-22T18:39:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[17964]: audit 2024-02-22T18:39:49.067312+0000 mon.a (mon.0) 291 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad58d21e-9da6-4d9d-92e6-30140338e2f6"}]: dispatch 2024-02-22T18:39:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[17964]: audit 2024-02-22T18:39:49.076566+0000 mon.a (mon.0) 292 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad58d21e-9da6-4d9d-92e6-30140338e2f6"}]': finished 2024-02-22T18:39:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[17964]: cluster 2024-02-22T18:39:49.076723+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-22T18:39:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:49 smithi040 bash[17964]: audit 2024-02-22T18:39:49.076972+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:39:49.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:49 smithi111 bash[14162]: cluster 2024-02-22T18:39:48.544453+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v65: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:49.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:49 smithi111 bash[14162]: audit 2024-02-22T18:39:49.066402+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.15.40:0/3014381799' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad58d21e-9da6-4d9d-92e6-30140338e2f6"}]: dispatch 2024-02-22T18:39:49.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:49 smithi111 bash[14162]: audit 2024-02-22T18:39:49.067312+0000 mon.a (mon.0) 291 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad58d21e-9da6-4d9d-92e6-30140338e2f6"}]: dispatch 2024-02-22T18:39:49.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:49 smithi111 bash[14162]: audit 2024-02-22T18:39:49.076566+0000 mon.a (mon.0) 292 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad58d21e-9da6-4d9d-92e6-30140338e2f6"}]': finished 2024-02-22T18:39:49.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:49 smithi111 bash[14162]: cluster 2024-02-22T18:39:49.076723+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-22T18:39:49.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:49 smithi111 bash[14162]: audit 2024-02-22T18:39:49.076972+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:39:50.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:50 smithi040 bash[13988]: audit 2024-02-22T18:39:49.685812+0000 mon.a (mon.0) 295 : audit [DBG] from='client.? 172.21.15.40:0/2831119460' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:39:50.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:50 smithi040 bash[13988]: cluster 2024-02-22T18:39:50.545117+0000 mgr.y (mgr.14138) 96 : cluster [DBG] pgmap v67: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:50.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:50 smithi040 bash[17964]: audit 2024-02-22T18:39:49.685812+0000 mon.a (mon.0) 295 : audit [DBG] from='client.? 172.21.15.40:0/2831119460' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:39:50.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:50 smithi040 bash[17964]: cluster 2024-02-22T18:39:50.545117+0000 mgr.y (mgr.14138) 96 : cluster [DBG] pgmap v67: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:50.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:50 smithi111 bash[14162]: audit 2024-02-22T18:39:49.685812+0000 mon.a (mon.0) 295 : audit [DBG] from='client.? 172.21.15.40:0/2831119460' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:39:50.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:50 smithi111 bash[14162]: cluster 2024-02-22T18:39:50.545117+0000 mgr.y (mgr.14138) 96 : cluster [DBG] pgmap v67: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:52.823 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:52 smithi040 bash[13988]: audit 2024-02-22T18:39:52.521064+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:52.823 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:52 smithi040 bash[17964]: audit 2024-02-22T18:39:52.521064+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:52.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:52 smithi111 bash[14162]: audit 2024-02-22T18:39:52.521064+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:39:53.892 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:53 smithi040 bash[13988]: cluster 2024-02-22T18:39:52.546100+0000 mgr.y (mgr.14138) 97 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:53.892 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:53 smithi040 bash[17964]: cluster 2024-02-22T18:39:52.546100+0000 mgr.y (mgr.14138) 97 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:53.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:53 smithi111 bash[14162]: cluster 2024-02-22T18:39:52.546100+0000 mgr.y (mgr.14138) 97 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:54.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:54 smithi040 bash[13988]: cluster 2024-02-22T18:39:53.540612+0000 mon.a (mon.0) 297 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T18:39:54.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:54 smithi040 bash[17964]: cluster 2024-02-22T18:39:53.540612+0000 mon.a (mon.0) 297 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T18:39:54.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:54 smithi111 bash[14162]: cluster 2024-02-22T18:39:53.540612+0000 mon.a (mon.0) 297 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T18:39:55.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:55 smithi040 bash[13988]: cluster 2024-02-22T18:39:54.546732+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:55 smithi040 bash[17964]: cluster 2024-02-22T18:39:54.546732+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:55.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:55 smithi111 bash[14162]: cluster 2024-02-22T18:39:54.546732+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:56 smithi040 bash[13988]: audit 2024-02-22T18:39:56.176289+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T18:39:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:56 smithi040 bash[13988]: audit 2024-02-22T18:39:56.178412+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:56 smithi040 bash[13988]: audit 2024-02-22T18:39:56.180480+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-22T18:39:56.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:56 smithi040 bash[17964]: audit 2024-02-22T18:39:56.176289+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T18:39:56.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:56 smithi040 bash[17964]: audit 2024-02-22T18:39:56.178412+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:56.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:56 smithi040 bash[17964]: audit 2024-02-22T18:39:56.180480+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-22T18:39:56.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:56 smithi111 bash[14162]: audit 2024-02-22T18:39:56.176289+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T18:39:56.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:56 smithi111 bash[14162]: audit 2024-02-22T18:39:56.178412+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:39:56.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:56 smithi111 bash[14162]: audit 2024-02-22T18:39:56.180480+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-22T18:39:57.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:57 smithi040 bash[17964]: cephadm 2024-02-22T18:39:56.179833+0000 mgr.y (mgr.14138) 99 : cephadm [INF] Deploying daemon osd.1 on smithi040 2024-02-22T18:39:57.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:57 smithi040 bash[17964]: cluster 2024-02-22T18:39:56.547229+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v70: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:57 smithi040 bash[13988]: cephadm 2024-02-22T18:39:56.179833+0000 mgr.y (mgr.14138) 99 : cephadm [INF] Deploying daemon osd.1 on smithi040 2024-02-22T18:39:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:57 smithi040 bash[13988]: cluster 2024-02-22T18:39:56.547229+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v70: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:57.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:57 smithi111 bash[14162]: cephadm 2024-02-22T18:39:56.179833+0000 mgr.y (mgr.14138) 99 : cephadm [INF] Deploying daemon osd.1 on smithi040 2024-02-22T18:39:57.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:57 smithi111 bash[14162]: cluster 2024-02-22T18:39:56.547229+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v70: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:58.582 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 1 on host 'smithi040' 2024-02-22T18:39:59.904 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:59 smithi040 bash[17964]: cluster 2024-02-22T18:39:58.547566+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:59.905 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:59 smithi040 bash[17964]: audit 2024-02-22T18:39:58.574103+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:59.905 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:39:59 smithi040 bash[17964]: audit 2024-02-22T18:39:58.578786+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:59.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:59 smithi040 bash[13988]: cluster 2024-02-22T18:39:58.547566+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:59.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:59 smithi040 bash[13988]: audit 2024-02-22T18:39:58.574103+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:59.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:39:59 smithi040 bash[13988]: audit 2024-02-22T18:39:58.578786+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:39:59.906 DEBUG:teuthology.orchestra.run.smithi040:osd.1> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.1.service 2024-02-22T18:39:59.908 INFO:tasks.cephadm:Deploying osd.2 on smithi040 with /dev/vg_nvme/lv_2... 2024-02-22T18:39:59.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-22T18:39:59.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:59 smithi111 bash[14162]: cluster 2024-02-22T18:39:58.547566+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:39:59.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:59 smithi111 bash[14162]: audit 2024-02-22T18:39:58.574103+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:39:59.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:39:59 smithi111 bash[14162]: audit 2024-02-22T18:39:58.578786+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:00.483 INFO:journalctl@ceph.osd.1.smithi040.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:40:00.892 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[22005]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-22T18:40:00.893 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[22005]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-02-22T18:40:00.893 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[22005]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-22T18:40:00.893 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[22005]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-02-22T18:40:00.893 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[22005]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-22T18:40:00.893 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[22005]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-22T18:40:00.893 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[22005]: --> ceph-volume lvm activate successful for osd ID: 1 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[13988]: audit 2024-02-22T18:39:59.881304+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[13988]: audit 2024-02-22T18:39:59.883033+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[13988]: cluster 2024-02-22T18:40:00.000124+0000 mon.a (mon.0) 305 : cluster [WRN] Health detail: HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[13988]: cluster 2024-02-22T18:40:00.000169+0000 mon.a (mon.0) 306 : cluster [WRN] [WRN] PG_AVAILABILITY: Reduced data availability: 1 pg inactive 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[13988]: cluster 2024-02-22T18:40:00.000206+0000 mon.a (mon.0) 307 : cluster [WRN] pg 1.0 is stuck inactive for 83s, current state undersized+peered, last acting [0] 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[13988]: cluster 2024-02-22T18:40:00.548093+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[17964]: audit 2024-02-22T18:39:59.881304+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[17964]: audit 2024-02-22T18:39:59.883033+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[17964]: cluster 2024-02-22T18:40:00.000124+0000 mon.a (mon.0) 305 : cluster [WRN] Health detail: HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-22T18:40:01.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[17964]: cluster 2024-02-22T18:40:00.000169+0000 mon.a (mon.0) 306 : cluster [WRN] [WRN] PG_AVAILABILITY: Reduced data availability: 1 pg inactive 2024-02-22T18:40:01.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[17964]: cluster 2024-02-22T18:40:00.000206+0000 mon.a (mon.0) 307 : cluster [WRN] pg 1.0 is stuck inactive for 83s, current state undersized+peered, last acting [0] 2024-02-22T18:40:01.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:00 smithi040 bash[17964]: cluster 2024-02-22T18:40:00.548093+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:01.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:00 smithi111 bash[14162]: audit 2024-02-22T18:39:59.881304+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:01.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:00 smithi111 bash[14162]: audit 2024-02-22T18:39:59.883033+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:01.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:00 smithi111 bash[14162]: cluster 2024-02-22T18:40:00.000124+0000 mon.a (mon.0) 305 : cluster [WRN] Health detail: HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-22T18:40:01.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:00 smithi111 bash[14162]: cluster 2024-02-22T18:40:00.000169+0000 mon.a (mon.0) 306 : cluster [WRN] [WRN] PG_AVAILABILITY: Reduced data availability: 1 pg inactive 2024-02-22T18:40:01.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:00 smithi111 bash[14162]: cluster 2024-02-22T18:40:00.000206+0000 mon.a (mon.0) 307 : cluster [WRN] pg 1.0 is stuck inactive for 83s, current state undersized+peered, last acting [0] 2024-02-22T18:40:01.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:00 smithi111 bash[14162]: cluster 2024-02-22T18:40:00.548093+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:02.804 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:02 smithi040 bash[13988]: cluster 2024-02-22T18:40:02.548752+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:02.804 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:02 smithi040 bash[17964]: cluster 2024-02-22T18:40:02.548752+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:02.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:02 smithi111 bash[14162]: cluster 2024-02-22T18:40:02.548752+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:03.243 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:02 smithi040 bash[22240]: debug 2024-02-22T18:40:02.836+0000 7fbf425def40 1 -- 172.21.15.40:0/2508278315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5608d6d2d000 msgr2=0x5608d6c9fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T18:40:03.243 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:02 smithi040 bash[22240]: debug 2024-02-22T18:40:02.836+0000 7fbf425def40 1 --2- 172.21.15.40:0/2508278315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5608d6d2d000 0x5608d6c9fe00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x5608d6cca240 tx=0x5608d6cea420).stop 2024-02-22T18:40:03.677 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:03 smithi040 bash[22240]: debug 2024-02-22T18:40:03.372+0000 7fbf425def40 -1 Falling back to public interface 2024-02-22T18:40:04.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:04 smithi040 bash[17964]: audit 2024-02-22T18:40:04.005183+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2470022647,v1:172.21.15.40:6811/2470022647]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T18:40:04.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:04 smithi040 bash[17964]: audit 2024-02-22T18:40:04.005642+0000 mon.a (mon.0) 308 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T18:40:04.428 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:04 smithi040 bash[22240]: debug 2024-02-22T18:40:03.996+0000 7fbf425def40 -1 osd.1 0 log_to_monitors {default=true} 2024-02-22T18:40:04.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:04 smithi040 bash[13988]: audit 2024-02-22T18:40:04.005183+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2470022647,v1:172.21.15.40:6811/2470022647]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T18:40:04.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:04 smithi040 bash[13988]: audit 2024-02-22T18:40:04.005642+0000 mon.a (mon.0) 308 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T18:40:04.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:04 smithi111 bash[14162]: audit 2024-02-22T18:40:04.005183+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2470022647,v1:172.21.15.40:6811/2470022647]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T18:40:04.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:04 smithi111 bash[14162]: audit 2024-02-22T18:40:04.005642+0000 mon.a (mon.0) 308 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T18:40:05.427 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[22240]: debug 2024-02-22T18:40:05.084+0000 7fbf2b0b4700 -1 osd.1 0 waiting for initial osdmap 2024-02-22T18:40:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[13988]: audit 2024-02-22T18:40:04.066590+0000 mon.a (mon.0) 309 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T18:40:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[13988]: cluster 2024-02-22T18:40:04.066777+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-22T18:40:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[13988]: audit 2024-02-22T18:40:04.067678+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[13988]: audit 2024-02-22T18:40:04.068604+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2470022647,v1:172.21.15.40:6811/2470022647]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[13988]: audit 2024-02-22T18:40:04.075610+0000 mon.a (mon.0) 312 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[13988]: cluster 2024-02-22T18:40:04.549374+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:05.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[17964]: audit 2024-02-22T18:40:04.066590+0000 mon.a (mon.0) 309 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T18:40:05.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[17964]: cluster 2024-02-22T18:40:04.066777+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-22T18:40:05.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[17964]: audit 2024-02-22T18:40:04.067678+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:05.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[17964]: audit 2024-02-22T18:40:04.068604+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2470022647,v1:172.21.15.40:6811/2470022647]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:05.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[17964]: audit 2024-02-22T18:40:04.075610+0000 mon.a (mon.0) 312 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:05.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:05 smithi040 bash[17964]: cluster 2024-02-22T18:40:04.549374+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:05.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:05 smithi111 bash[14162]: audit 2024-02-22T18:40:04.066590+0000 mon.a (mon.0) 309 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T18:40:05.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:05 smithi111 bash[14162]: cluster 2024-02-22T18:40:04.066777+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-22T18:40:05.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:05 smithi111 bash[14162]: audit 2024-02-22T18:40:04.067678+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:05.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:05 smithi111 bash[14162]: audit 2024-02-22T18:40:04.068604+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2470022647,v1:172.21.15.40:6811/2470022647]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:05.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:05 smithi111 bash[14162]: audit 2024-02-22T18:40:04.075610+0000 mon.a (mon.0) 312 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:05.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:05 smithi111 bash[14162]: cluster 2024-02-22T18:40:04.549374+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:05.687 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-22T18:40:05.687 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-22T18:40:05.687 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-02-22T18:40:05.687 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-02-22T18:40:05.688 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0198726 s, 528 MB/s 2024-02-22T18:40:05.688 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-02-22T18:40:06.100 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:06 smithi040 bash[13988]: audit 2024-02-22T18:40:05.080360+0000 mon.a (mon.0) 313 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:40:06.100 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:06 smithi040 bash[13988]: cluster 2024-02-22T18:40:05.080862+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-22T18:40:06.100 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:06 smithi040 bash[13988]: audit 2024-02-22T18:40:05.081684+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:06.100 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:06 smithi040 bash[13988]: audit 2024-02-22T18:40:05.091764+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:06.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:06 smithi040 bash[17964]: audit 2024-02-22T18:40:05.080360+0000 mon.a (mon.0) 313 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:40:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:06 smithi040 bash[17964]: cluster 2024-02-22T18:40:05.080862+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-22T18:40:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:06 smithi040 bash[17964]: audit 2024-02-22T18:40:05.081684+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:06 smithi040 bash[17964]: audit 2024-02-22T18:40:05.091764+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:06.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_2 2024-02-22T18:40:06.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:06 smithi111 bash[14162]: audit 2024-02-22T18:40:05.080360+0000 mon.a (mon.0) 313 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:40:06.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:06 smithi111 bash[14162]: cluster 2024-02-22T18:40:05.080862+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-22T18:40:06.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:06 smithi111 bash[14162]: audit 2024-02-22T18:40:05.081684+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:06.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:06 smithi111 bash[14162]: audit 2024-02-22T18:40:05.091764+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:07.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[13988]: cluster 2024-02-22T18:40:04.961058+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:40:07.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[13988]: cluster 2024-02-22T18:40:04.961182+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:40:07.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[13988]: cluster 2024-02-22T18:40:06.092914+0000 mon.a (mon.0) 317 : cluster [INF] osd.1 [v2:172.21.15.40:6810/2470022647,v1:172.21.15.40:6811/2470022647] boot 2024-02-22T18:40:07.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[13988]: cluster 2024-02-22T18:40:06.093025+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-22T18:40:07.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[13988]: audit 2024-02-22T18:40:06.093907+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:07.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[13988]: cluster 2024-02-22T18:40:06.549731+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:07.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[17964]: cluster 2024-02-22T18:40:04.961058+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:40:07.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[17964]: cluster 2024-02-22T18:40:04.961182+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:40:07.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[17964]: cluster 2024-02-22T18:40:06.092914+0000 mon.a (mon.0) 317 : cluster [INF] osd.1 [v2:172.21.15.40:6810/2470022647,v1:172.21.15.40:6811/2470022647] boot 2024-02-22T18:40:07.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[17964]: cluster 2024-02-22T18:40:06.093025+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-22T18:40:07.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[17964]: audit 2024-02-22T18:40:06.093907+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:07.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:07 smithi040 bash[17964]: cluster 2024-02-22T18:40:06.549731+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:07.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:07 smithi111 bash[14162]: cluster 2024-02-22T18:40:04.961058+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:40:07.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:07 smithi111 bash[14162]: cluster 2024-02-22T18:40:04.961182+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:40:07.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:07 smithi111 bash[14162]: cluster 2024-02-22T18:40:06.092914+0000 mon.a (mon.0) 317 : cluster [INF] osd.1 [v2:172.21.15.40:6810/2470022647,v1:172.21.15.40:6811/2470022647] boot 2024-02-22T18:40:07.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:07 smithi111 bash[14162]: cluster 2024-02-22T18:40:06.093025+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-22T18:40:07.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:07 smithi111 bash[14162]: audit 2024-02-22T18:40:06.093907+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:40:07.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:07 smithi111 bash[14162]: cluster 2024-02-22T18:40:06.549731+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-02-22T18:40:08.390 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:08 smithi040 bash[17964]: cluster 2024-02-22T18:40:07.108510+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-22T18:40:08.390 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:08 smithi040 bash[17964]: audit 2024-02-22T18:40:07.901276+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:08.390 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:08 smithi040 bash[13988]: cluster 2024-02-22T18:40:07.108510+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-22T18:40:08.390 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:08 smithi040 bash[13988]: audit 2024-02-22T18:40:07.901276+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:08.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:08 smithi111 bash[14162]: cluster 2024-02-22T18:40:07.108510+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-22T18:40:08.463 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:08 smithi111 bash[14162]: audit 2024-02-22T18:40:07.901276+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:09.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[17964]: audit 2024-02-22T18:40:08.214577+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:09.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[17964]: cephadm 2024-02-22T18:40:08.215546+0000 mgr.y (mgr.14138) 106 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:40:09.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[17964]: cluster 2024-02-22T18:40:08.550123+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:09.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[17964]: audit 2024-02-22T18:40:08.563621+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:09.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[17964]: audit 2024-02-22T18:40:08.566331+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:09.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[17964]: audit 2024-02-22T18:40:09.210591+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:09.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[13988]: audit 2024-02-22T18:40:08.214577+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:09.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[13988]: cephadm 2024-02-22T18:40:08.215546+0000 mgr.y (mgr.14138) 106 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:40:09.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[13988]: cluster 2024-02-22T18:40:08.550123+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:09.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[13988]: audit 2024-02-22T18:40:08.563621+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:09.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[13988]: audit 2024-02-22T18:40:08.566331+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:09.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:09 smithi040 bash[13988]: audit 2024-02-22T18:40:09.210591+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:09.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:09 smithi111 bash[14162]: audit 2024-02-22T18:40:08.214577+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:09.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:09 smithi111 bash[14162]: cephadm 2024-02-22T18:40:08.215546+0000 mgr.y (mgr.14138) 106 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:40:09.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:09 smithi111 bash[14162]: cluster 2024-02-22T18:40:08.550123+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:09.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:09 smithi111 bash[14162]: audit 2024-02-22T18:40:08.563621+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:09.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:09 smithi111 bash[14162]: audit 2024-02-22T18:40:08.566331+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:09.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:09 smithi111 bash[14162]: audit 2024-02-22T18:40:09.210591+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:10.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[17964]: audit 2024-02-22T18:40:09.224756+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:10.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[17964]: audit 2024-02-22T18:40:10.017179+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:40:10.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[17964]: audit 2024-02-22T18:40:10.019501+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:40:10.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[17964]: audit 2024-02-22T18:40:10.020901+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:10.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[17964]: audit 2024-02-22T18:40:10.022467+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:10.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[13988]: audit 2024-02-22T18:40:09.224756+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:10.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[13988]: audit 2024-02-22T18:40:10.017179+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:40:10.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[13988]: audit 2024-02-22T18:40:10.019501+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:40:10.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[13988]: audit 2024-02-22T18:40:10.020901+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:10.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:10 smithi040 bash[13988]: audit 2024-02-22T18:40:10.022467+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:10.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:10 smithi111 bash[14162]: audit 2024-02-22T18:40:09.224756+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:10.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:10 smithi111 bash[14162]: audit 2024-02-22T18:40:10.017179+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:40:10.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:10 smithi111 bash[14162]: audit 2024-02-22T18:40:10.019501+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:40:10.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:10 smithi111 bash[14162]: audit 2024-02-22T18:40:10.020901+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:10.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:10 smithi111 bash[14162]: audit 2024-02-22T18:40:10.022467+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:11.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:11 smithi040 bash[13988]: audit 2024-02-22T18:40:10.015925+0000 mgr.y (mgr.14138) 108 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:40:11.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:11 smithi040 bash[13988]: cephadm 2024-02-22T18:40:10.019008+0000 mgr.y (mgr.14138) 109 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:40:11.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:11 smithi040 bash[13988]: cluster 2024-02-22T18:40:10.550661+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:11.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:11 smithi040 bash[17964]: audit 2024-02-22T18:40:10.015925+0000 mgr.y (mgr.14138) 108 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:40:11.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:11 smithi040 bash[17964]: cephadm 2024-02-22T18:40:10.019008+0000 mgr.y (mgr.14138) 109 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:40:11.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:11 smithi040 bash[17964]: cluster 2024-02-22T18:40:10.550661+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:11.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:11 smithi111 bash[14162]: audit 2024-02-22T18:40:10.015925+0000 mgr.y (mgr.14138) 108 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:40:11.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:11 smithi111 bash[14162]: cephadm 2024-02-22T18:40:10.019008+0000 mgr.y (mgr.14138) 109 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:40:11.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:11 smithi111 bash[14162]: cluster 2024-02-22T18:40:10.550661+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:12.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:12 smithi040 bash[17964]: cluster 2024-02-22T18:40:12.551245+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:12.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:12 smithi040 bash[17964]: cluster 2024-02-22T18:40:12.602420+0000 mon.a (mon.0) 331 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-22T18:40:12.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:12 smithi040 bash[17964]: cluster 2024-02-22T18:40:12.602494+0000 mon.a (mon.0) 332 : cluster [INF] Cluster is now healthy 2024-02-22T18:40:12.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:12 smithi040 bash[13988]: cluster 2024-02-22T18:40:12.551245+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:12.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:12 smithi040 bash[13988]: cluster 2024-02-22T18:40:12.602420+0000 mon.a (mon.0) 331 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-22T18:40:12.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:12 smithi040 bash[13988]: cluster 2024-02-22T18:40:12.602494+0000 mon.a (mon.0) 332 : cluster [INF] Cluster is now healthy 2024-02-22T18:40:12.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:12 smithi111 bash[14162]: cluster 2024-02-22T18:40:12.551245+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:12.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:12 smithi111 bash[14162]: cluster 2024-02-22T18:40:12.602420+0000 mon.a (mon.0) 331 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-22T18:40:12.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:12 smithi111 bash[14162]: cluster 2024-02-22T18:40:12.602494+0000 mon.a (mon.0) 332 : cluster [INF] Cluster is now healthy 2024-02-22T18:40:13.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[13988]: audit 2024-02-22T18:40:13.480651+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.40:0/80805328' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c217ed3-b763-4e88-9c69-698c6f73d47d"}]: dispatch 2024-02-22T18:40:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[13988]: audit 2024-02-22T18:40:13.481205+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c217ed3-b763-4e88-9c69-698c6f73d47d"}]: dispatch 2024-02-22T18:40:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[13988]: audit 2024-02-22T18:40:13.488681+0000 mon.a (mon.0) 334 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c217ed3-b763-4e88-9c69-698c6f73d47d"}]': finished 2024-02-22T18:40:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[13988]: cluster 2024-02-22T18:40:13.488841+0000 mon.a (mon.0) 335 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-22T18:40:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[13988]: audit 2024-02-22T18:40:13.489130+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[17964]: audit 2024-02-22T18:40:13.480651+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.40:0/80805328' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c217ed3-b763-4e88-9c69-698c6f73d47d"}]: dispatch 2024-02-22T18:40:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[17964]: audit 2024-02-22T18:40:13.481205+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c217ed3-b763-4e88-9c69-698c6f73d47d"}]: dispatch 2024-02-22T18:40:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[17964]: audit 2024-02-22T18:40:13.488681+0000 mon.a (mon.0) 334 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c217ed3-b763-4e88-9c69-698c6f73d47d"}]': finished 2024-02-22T18:40:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[17964]: cluster 2024-02-22T18:40:13.488841+0000 mon.a (mon.0) 335 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-22T18:40:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:13 smithi040 bash[17964]: audit 2024-02-22T18:40:13.489130+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:13.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:13 smithi111 bash[14162]: audit 2024-02-22T18:40:13.480651+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.40:0/80805328' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c217ed3-b763-4e88-9c69-698c6f73d47d"}]: dispatch 2024-02-22T18:40:13.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:13 smithi111 bash[14162]: audit 2024-02-22T18:40:13.481205+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c217ed3-b763-4e88-9c69-698c6f73d47d"}]: dispatch 2024-02-22T18:40:13.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:13 smithi111 bash[14162]: audit 2024-02-22T18:40:13.488681+0000 mon.a (mon.0) 334 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c217ed3-b763-4e88-9c69-698c6f73d47d"}]': finished 2024-02-22T18:40:13.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:13 smithi111 bash[14162]: cluster 2024-02-22T18:40:13.488841+0000 mon.a (mon.0) 335 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-22T18:40:13.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:13 smithi111 bash[14162]: audit 2024-02-22T18:40:13.489130+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:14.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:14 smithi040 bash[13988]: audit 2024-02-22T18:40:14.142140+0000 mon.a (mon.0) 337 : audit [DBG] from='client.? 172.21.15.40:0/4189558287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:40:14.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:14 smithi040 bash[13988]: cluster 2024-02-22T18:40:14.551818+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v84: 1 pgs: 1 active+undersized; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:14.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:14 smithi040 bash[17964]: audit 2024-02-22T18:40:14.142140+0000 mon.a (mon.0) 337 : audit [DBG] from='client.? 172.21.15.40:0/4189558287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:40:14.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:14 smithi040 bash[17964]: cluster 2024-02-22T18:40:14.551818+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v84: 1 pgs: 1 active+undersized; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:14.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:14 smithi111 bash[14162]: audit 2024-02-22T18:40:14.142140+0000 mon.a (mon.0) 337 : audit [DBG] from='client.? 172.21.15.40:0/4189558287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:40:14.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:14 smithi111 bash[14162]: cluster 2024-02-22T18:40:14.551818+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v84: 1 pgs: 1 active+undersized; 0 B data, 304 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:17.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:17 smithi040 bash[17964]: cluster 2024-02-22T18:40:16.552306+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:17.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:17 smithi040 bash[17964]: audit 2024-02-22T18:40:17.031767+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:17.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:17 smithi040 bash[13988]: cluster 2024-02-22T18:40:16.552306+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:17.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:17 smithi040 bash[13988]: audit 2024-02-22T18:40:17.031767+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:17.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:17 smithi111 bash[14162]: cluster 2024-02-22T18:40:16.552306+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:17.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:17 smithi111 bash[14162]: audit 2024-02-22T18:40:17.031767+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:18.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:18 smithi040 bash[13988]: cluster 2024-02-22T18:40:18.552844+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v86: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:18.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:18 smithi040 bash[17964]: cluster 2024-02-22T18:40:18.552844+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v86: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:18.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:18 smithi111 bash[14162]: cluster 2024-02-22T18:40:18.552844+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v86: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:20.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:20 smithi040 bash[13988]: cluster 2024-02-22T18:40:20.553489+0000 mgr.y (mgr.14138) 115 : cluster [DBG] pgmap v87: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:20.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:20 smithi040 bash[17964]: cluster 2024-02-22T18:40:20.553489+0000 mgr.y (mgr.14138) 115 : cluster [DBG] pgmap v87: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:20.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:20 smithi111 bash[14162]: cluster 2024-02-22T18:40:20.553489+0000 mgr.y (mgr.14138) 115 : cluster [DBG] pgmap v87: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:21.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:21 smithi040 bash[17964]: audit 2024-02-22T18:40:20.762268+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T18:40:21.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:21 smithi040 bash[17964]: audit 2024-02-22T18:40:20.764099+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:21.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:21 smithi040 bash[17964]: cephadm 2024-02-22T18:40:20.765576+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Deploying daemon osd.2 on smithi040 2024-02-22T18:40:21.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:21 smithi040 bash[17964]: audit 2024-02-22T18:40:20.766234+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-22T18:40:21.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:21 smithi040 bash[13988]: audit 2024-02-22T18:40:20.762268+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T18:40:21.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:21 smithi040 bash[13988]: audit 2024-02-22T18:40:20.764099+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:21.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:21 smithi040 bash[13988]: cephadm 2024-02-22T18:40:20.765576+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Deploying daemon osd.2 on smithi040 2024-02-22T18:40:21.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:21 smithi040 bash[13988]: audit 2024-02-22T18:40:20.766234+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-22T18:40:21.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:21 smithi111 bash[14162]: audit 2024-02-22T18:40:20.762268+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T18:40:21.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:21 smithi111 bash[14162]: audit 2024-02-22T18:40:20.764099+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:21.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:21 smithi111 bash[14162]: cephadm 2024-02-22T18:40:20.765576+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Deploying daemon osd.2 on smithi040 2024-02-22T18:40:21.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:21 smithi111 bash[14162]: audit 2024-02-22T18:40:20.766234+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-22T18:40:22.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:22 smithi040 bash[13988]: cluster 2024-02-22T18:40:22.554207+0000 mgr.y (mgr.14138) 117 : cluster [DBG] pgmap v88: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:22.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:22 smithi040 bash[17964]: cluster 2024-02-22T18:40:22.554207+0000 mgr.y (mgr.14138) 117 : cluster [DBG] pgmap v88: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:22.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:22 smithi111 bash[14162]: cluster 2024-02-22T18:40:22.554207+0000 mgr.y (mgr.14138) 117 : cluster [DBG] pgmap v88: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:23.151 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 2 on host 'smithi040' 2024-02-22T18:40:23.899 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:23 smithi040 bash[13988]: audit 2024-02-22T18:40:23.145455+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:23.899 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:23 smithi040 bash[13988]: audit 2024-02-22T18:40:23.148720+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:23.899 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:23 smithi040 bash[17964]: audit 2024-02-22T18:40:23.145455+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:23.899 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:23 smithi040 bash[17964]: audit 2024-02-22T18:40:23.148720+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:23.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:23 smithi111 bash[14162]: audit 2024-02-22T18:40:23.145455+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:23.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:23 smithi111 bash[14162]: audit 2024-02-22T18:40:23.148720+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:24.908 DEBUG:teuthology.orchestra.run.smithi040:osd.2> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.2.service 2024-02-22T18:40:24.910 INFO:tasks.cephadm:Deploying osd.3 on smithi040 with /dev/vg_nvme/lv_1... 2024-02-22T18:40:24.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-22T18:40:25.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:24 smithi040 bash[13988]: audit 2024-02-22T18:40:23.941826+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:25.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:24 smithi040 bash[13988]: audit 2024-02-22T18:40:23.943541+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:25.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:24 smithi040 bash[13988]: cluster 2024-02-22T18:40:24.554845+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v89: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:25.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:24 smithi040 bash[17964]: audit 2024-02-22T18:40:23.941826+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:25.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:24 smithi040 bash[17964]: audit 2024-02-22T18:40:23.943541+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:25.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:24 smithi040 bash[17964]: cluster 2024-02-22T18:40:24.554845+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v89: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:25.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:24 smithi111 bash[14162]: audit 2024-02-22T18:40:23.941826+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:25.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:24 smithi111 bash[14162]: audit 2024-02-22T18:40:23.943541+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:25.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:24 smithi111 bash[14162]: cluster 2024-02-22T18:40:24.554845+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v89: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:25.295 INFO:journalctl@ceph.osd.2.smithi040.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:40:26.427 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:26 smithi040 bash[23699]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-22T18:40:26.428 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:26 smithi040 bash[23699]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-02-22T18:40:26.428 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:26 smithi040 bash[23699]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-22T18:40:26.428 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:26 smithi040 bash[23699]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-02-22T18:40:26.428 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:26 smithi040 bash[23699]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-22T18:40:26.428 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:26 smithi040 bash[23699]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-22T18:40:26.428 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:26 smithi040 bash[23699]: --> ceph-volume lvm activate successful for osd ID: 2 2024-02-22T18:40:27.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:27 smithi040 bash[13988]: cluster 2024-02-22T18:40:26.555521+0000 mgr.y (mgr.14138) 119 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:27.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:27 smithi040 bash[17964]: cluster 2024-02-22T18:40:26.555521+0000 mgr.y (mgr.14138) 119 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:27.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:27 smithi111 bash[14162]: cluster 2024-02-22T18:40:26.555521+0000 mgr.y (mgr.14138) 119 : cluster [DBG] pgmap v90: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:28.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:28 smithi040 bash[13988]: cluster 2024-02-22T18:40:28.556240+0000 mgr.y (mgr.14138) 120 : cluster [DBG] pgmap v91: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:28.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:28 smithi040 bash[17964]: cluster 2024-02-22T18:40:28.556240+0000 mgr.y (mgr.14138) 120 : cluster [DBG] pgmap v91: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:28.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:28 smithi111 bash[14162]: cluster 2024-02-22T18:40:28.556240+0000 mgr.y (mgr.14138) 120 : cluster [DBG] pgmap v91: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:30.651 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:30 smithi040 bash[24087]: debug 2024-02-22T18:40:30.448+0000 7f61962cbf40 -1 Falling back to public interface 2024-02-22T18:40:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-22T18:40:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-22T18:40:30.878 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-02-22T18:40:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-02-22T18:40:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.014606 s, 718 MB/s 2024-02-22T18:40:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-02-22T18:40:30.916 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:30 smithi040 bash[17964]: cluster 2024-02-22T18:40:30.556807+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:30.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:30 smithi040 bash[13988]: cluster 2024-02-22T18:40:30.556807+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:30.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:30 smithi111 bash[14162]: cluster 2024-02-22T18:40:30.556807+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:31.177 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:31 smithi040 bash[24087]: debug 2024-02-22T18:40:31.100+0000 7f61962cbf40 -1 osd.2 0 log_to_monitors {default=true} 2024-02-22T18:40:31.711 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:31 smithi040 bash[13988]: audit 2024-02-22T18:40:31.109593+0000 mon.a (mon.0) 346 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T18:40:31.711 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:31 smithi040 bash[17964]: audit 2024-02-22T18:40:31.109593+0000 mon.a (mon.0) 346 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T18:40:31.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_1 2024-02-22T18:40:31.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:31 smithi111 bash[14162]: audit 2024-02-22T18:40:31.109593+0000 mon.a (mon.0) 346 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T18:40:32.927 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[24087]: debug 2024-02-22T18:40:32.664+0000 7f617eda1700 -1 osd.2 0 waiting for initial osdmap 2024-02-22T18:40:32.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[13988]: audit 2024-02-22T18:40:31.658160+0000 mon.a (mon.0) 347 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T18:40:32.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[13988]: cluster 2024-02-22T18:40:31.658372+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-22T18:40:32.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[13988]: audit 2024-02-22T18:40:31.659910+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:32.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[13988]: audit 2024-02-22T18:40:31.661026+0000 mon.a (mon.0) 350 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:32.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[13988]: audit 2024-02-22T18:40:32.467258+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:32.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[13988]: cluster 2024-02-22T18:40:32.557337+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:32.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[17964]: audit 2024-02-22T18:40:31.658160+0000 mon.a (mon.0) 347 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T18:40:32.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[17964]: cluster 2024-02-22T18:40:31.658372+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-22T18:40:32.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[17964]: audit 2024-02-22T18:40:31.659910+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:32.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[17964]: audit 2024-02-22T18:40:31.661026+0000 mon.a (mon.0) 350 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:32.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[17964]: audit 2024-02-22T18:40:32.467258+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:32.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:32 smithi040 bash[17964]: cluster 2024-02-22T18:40:32.557337+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:32.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:32 smithi111 bash[14162]: audit 2024-02-22T18:40:31.658160+0000 mon.a (mon.0) 347 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T18:40:32.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:32 smithi111 bash[14162]: cluster 2024-02-22T18:40:31.658372+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-22T18:40:32.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:32 smithi111 bash[14162]: audit 2024-02-22T18:40:31.659910+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:32.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:32 smithi111 bash[14162]: audit 2024-02-22T18:40:31.661026+0000 mon.a (mon.0) 350 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:32.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:32 smithi111 bash[14162]: audit 2024-02-22T18:40:32.467258+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:32.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:32 smithi111 bash[14162]: cluster 2024-02-22T18:40:32.557337+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:33 smithi111 bash[14162]: audit 2024-02-22T18:40:32.662860+0000 mon.a (mon.0) 352 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:40:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:33 smithi111 bash[14162]: cluster 2024-02-22T18:40:32.663228+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-22T18:40:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:33 smithi111 bash[14162]: audit 2024-02-22T18:40:32.663478+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:33 smithi111 bash[14162]: audit 2024-02-22T18:40:32.670298+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:33 smithi111 bash[14162]: audit 2024-02-22T18:40:32.778364+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:33 smithi111 bash[14162]: audit 2024-02-22T18:40:32.785216+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:33 smithi111 bash[14162]: audit 2024-02-22T18:40:32.793078+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:33.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:33 smithi111 bash[14162]: audit 2024-02-22T18:40:33.670060+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[13988]: audit 2024-02-22T18:40:32.662860+0000 mon.a (mon.0) 352 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:40:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[13988]: cluster 2024-02-22T18:40:32.663228+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-22T18:40:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[13988]: audit 2024-02-22T18:40:32.663478+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[13988]: audit 2024-02-22T18:40:32.670298+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[13988]: audit 2024-02-22T18:40:32.778364+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[13988]: audit 2024-02-22T18:40:32.785216+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[13988]: audit 2024-02-22T18:40:32.793078+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:34.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[13988]: audit 2024-02-22T18:40:33.670060+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[17964]: audit 2024-02-22T18:40:32.662860+0000 mon.a (mon.0) 352 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:40:34.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[17964]: cluster 2024-02-22T18:40:32.663228+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-22T18:40:34.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[17964]: audit 2024-02-22T18:40:32.663478+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[17964]: audit 2024-02-22T18:40:32.670298+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[17964]: audit 2024-02-22T18:40:32.778364+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:34.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[17964]: audit 2024-02-22T18:40:32.785216+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:34.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[17964]: audit 2024-02-22T18:40:32.793078+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:34.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:33 smithi040 bash[17964]: audit 2024-02-22T18:40:33.670060+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[13988]: cluster 2024-02-22T18:40:32.061435+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[13988]: cluster 2024-02-22T18:40:32.061555+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[13988]: cluster 2024-02-22T18:40:33.681921+0000 mon.a (mon.0) 360 : cluster [INF] osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800] boot 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[13988]: cluster 2024-02-22T18:40:33.681996+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[13988]: audit 2024-02-22T18:40:33.683426+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[13988]: cluster 2024-02-22T18:40:34.557830+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[17964]: cluster 2024-02-22T18:40:32.061435+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[17964]: cluster 2024-02-22T18:40:32.061555+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[17964]: cluster 2024-02-22T18:40:33.681921+0000 mon.a (mon.0) 360 : cluster [INF] osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800] boot 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[17964]: cluster 2024-02-22T18:40:33.681996+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-22T18:40:34.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[17964]: audit 2024-02-22T18:40:33.683426+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:34 smithi040 bash[17964]: cluster 2024-02-22T18:40:34.557830+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:34.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:34 smithi111 bash[14162]: cluster 2024-02-22T18:40:32.061435+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:40:34.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:34 smithi111 bash[14162]: cluster 2024-02-22T18:40:32.061555+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:40:34.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:34 smithi111 bash[14162]: cluster 2024-02-22T18:40:33.681921+0000 mon.a (mon.0) 360 : cluster [INF] osd.2 [v2:172.21.15.40:6818/1820825800,v1:172.21.15.40:6819/1820825800] boot 2024-02-22T18:40:34.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:34 smithi111 bash[14162]: cluster 2024-02-22T18:40:33.681996+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-22T18:40:34.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:34 smithi111 bash[14162]: audit 2024-02-22T18:40:33.683426+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:40:34.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:34 smithi111 bash[14162]: cluster 2024-02-22T18:40:34.557830+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail 2024-02-22T18:40:35.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:35 smithi111 bash[14162]: cluster 2024-02-22T18:40:34.700837+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-22T18:40:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:35 smithi111 bash[14162]: audit 2024-02-22T18:40:34.950332+0000 mgr.y (mgr.14138) 124 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:40:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:35 smithi111 bash[14162]: audit 2024-02-22T18:40:34.951506+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:40:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:35 smithi111 bash[14162]: cephadm 2024-02-22T18:40:34.953662+0000 mgr.y (mgr.14138) 125 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:40:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:35 smithi111 bash[14162]: audit 2024-02-22T18:40:34.954131+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:40:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:35 smithi111 bash[14162]: audit 2024-02-22T18:40:34.955641+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:35.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:35 smithi111 bash[14162]: audit 2024-02-22T18:40:34.957436+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:36.058 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[13988]: cluster 2024-02-22T18:40:34.700837+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-22T18:40:36.058 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[13988]: audit 2024-02-22T18:40:34.950332+0000 mgr.y (mgr.14138) 124 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:40:36.058 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[13988]: audit 2024-02-22T18:40:34.951506+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:40:36.058 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[13988]: cephadm 2024-02-22T18:40:34.953662+0000 mgr.y (mgr.14138) 125 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:40:36.058 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[13988]: audit 2024-02-22T18:40:34.954131+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:40:36.058 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[13988]: audit 2024-02-22T18:40:34.955641+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:36.058 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[13988]: audit 2024-02-22T18:40:34.957436+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:36.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[17964]: cluster 2024-02-22T18:40:34.700837+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-22T18:40:36.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[17964]: audit 2024-02-22T18:40:34.950332+0000 mgr.y (mgr.14138) 124 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:40:36.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[17964]: audit 2024-02-22T18:40:34.951506+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:40:36.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[17964]: cephadm 2024-02-22T18:40:34.953662+0000 mgr.y (mgr.14138) 125 : cephadm [INF] Applying drive group None on host smithi040... 2024-02-22T18:40:36.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[17964]: audit 2024-02-22T18:40:34.954131+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:40:36.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[17964]: audit 2024-02-22T18:40:34.955641+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:36.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:35 smithi040 bash[17964]: audit 2024-02-22T18:40:34.957436+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:37.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:37 smithi040 bash[13988]: cluster 2024-02-22T18:40:36.558356+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 528 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:37.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:37 smithi040 bash[17964]: cluster 2024-02-22T18:40:36.558356+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 528 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:37.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:37 smithi111 bash[14162]: cluster 2024-02-22T18:40:36.558356+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 528 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[13988]: audit 2024-02-22T18:40:38.405015+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.40:0/68964591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bc81e9-d620-44f8-87ab-e5936b9f42bf"}]: dispatch 2024-02-22T18:40:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[13988]: audit 2024-02-22T18:40:38.405823+0000 mon.a (mon.0) 368 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bc81e9-d620-44f8-87ab-e5936b9f42bf"}]: dispatch 2024-02-22T18:40:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[13988]: audit 2024-02-22T18:40:38.412037+0000 mon.a (mon.0) 369 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2bc81e9-d620-44f8-87ab-e5936b9f42bf"}]': finished 2024-02-22T18:40:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[13988]: cluster 2024-02-22T18:40:38.412127+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-22T18:40:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[13988]: audit 2024-02-22T18:40:38.412414+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[17964]: audit 2024-02-22T18:40:38.405015+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.40:0/68964591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bc81e9-d620-44f8-87ab-e5936b9f42bf"}]: dispatch 2024-02-22T18:40:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[17964]: audit 2024-02-22T18:40:38.405823+0000 mon.a (mon.0) 368 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bc81e9-d620-44f8-87ab-e5936b9f42bf"}]: dispatch 2024-02-22T18:40:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[17964]: audit 2024-02-22T18:40:38.412037+0000 mon.a (mon.0) 369 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2bc81e9-d620-44f8-87ab-e5936b9f42bf"}]': finished 2024-02-22T18:40:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[17964]: cluster 2024-02-22T18:40:38.412127+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-22T18:40:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:38 smithi040 bash[17964]: audit 2024-02-22T18:40:38.412414+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:38.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:38 smithi111 bash[14162]: audit 2024-02-22T18:40:38.405015+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.40:0/68964591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bc81e9-d620-44f8-87ab-e5936b9f42bf"}]: dispatch 2024-02-22T18:40:38.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:38 smithi111 bash[14162]: audit 2024-02-22T18:40:38.405823+0000 mon.a (mon.0) 368 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bc81e9-d620-44f8-87ab-e5936b9f42bf"}]: dispatch 2024-02-22T18:40:38.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:38 smithi111 bash[14162]: audit 2024-02-22T18:40:38.412037+0000 mon.a (mon.0) 369 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2bc81e9-d620-44f8-87ab-e5936b9f42bf"}]': finished 2024-02-22T18:40:38.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:38 smithi111 bash[14162]: cluster 2024-02-22T18:40:38.412127+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-22T18:40:38.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:38 smithi111 bash[14162]: audit 2024-02-22T18:40:38.412414+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:39.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:39 smithi040 bash[13988]: cluster 2024-02-22T18:40:38.558883+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:39.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:39 smithi040 bash[13988]: audit 2024-02-22T18:40:39.008647+0000 mon.a (mon.0) 372 : audit [DBG] from='client.? 172.21.15.40:0/993950333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:40:39.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:39 smithi040 bash[17964]: cluster 2024-02-22T18:40:38.558883+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:39.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:39 smithi040 bash[17964]: audit 2024-02-22T18:40:39.008647+0000 mon.a (mon.0) 372 : audit [DBG] from='client.? 172.21.15.40:0/993950333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:40:39.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:39 smithi111 bash[14162]: cluster 2024-02-22T18:40:38.558883+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:39.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:39 smithi111 bash[14162]: audit 2024-02-22T18:40:39.008647+0000 mon.a (mon.0) 372 : audit [DBG] from='client.? 172.21.15.40:0/993950333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:40:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:41 smithi040 bash[17964]: cluster 2024-02-22T18:40:40.559573+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:41 smithi040 bash[13988]: cluster 2024-02-22T18:40:40.559573+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:41.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:41 smithi111 bash[14162]: cluster 2024-02-22T18:40:40.559573+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:42.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:42 smithi040 bash[13988]: audit 2024-02-22T18:40:42.029434+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:42.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:42 smithi040 bash[17964]: audit 2024-02-22T18:40:42.029434+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:42.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:42 smithi111 bash[14162]: audit 2024-02-22T18:40:42.029434+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:43.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:43 smithi040 bash[17964]: cluster 2024-02-22T18:40:42.560221+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:43 smithi040 bash[17964]: audit 2024-02-22T18:40:42.727614+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:40:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:43 smithi040 bash[17964]: audit 2024-02-22T18:40:42.730447+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:40:43.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:43 smithi040 bash[13988]: cluster 2024-02-22T18:40:42.560221+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:43.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:43 smithi040 bash[13988]: audit 2024-02-22T18:40:42.727614+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:40:43.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:43 smithi040 bash[13988]: audit 2024-02-22T18:40:42.730447+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:40:43.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:43 smithi111 bash[14162]: cluster 2024-02-22T18:40:42.560221+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:43.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:43 smithi111 bash[14162]: audit 2024-02-22T18:40:42.727614+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:40:43.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:43 smithi111 bash[14162]: audit 2024-02-22T18:40:42.730447+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:40:45.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:45 smithi040 bash[13988]: cluster 2024-02-22T18:40:44.560827+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:45.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:45 smithi040 bash[17964]: cluster 2024-02-22T18:40:44.560827+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:45.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:45 smithi111 bash[14162]: cluster 2024-02-22T18:40:44.560827+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:46.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:46 smithi040 bash[13988]: audit 2024-02-22T18:40:46.198565+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T18:40:46.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:46 smithi040 bash[13988]: audit 2024-02-22T18:40:46.200120+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:46.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:46 smithi040 bash[13988]: audit 2024-02-22T18:40:46.202368+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-22T18:40:46.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:46 smithi040 bash[17964]: audit 2024-02-22T18:40:46.198565+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T18:40:46.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:46 smithi040 bash[17964]: audit 2024-02-22T18:40:46.200120+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:46.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:46 smithi040 bash[17964]: audit 2024-02-22T18:40:46.202368+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-22T18:40:46.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:46 smithi111 bash[14162]: audit 2024-02-22T18:40:46.198565+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T18:40:46.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:46 smithi111 bash[14162]: audit 2024-02-22T18:40:46.200120+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:46.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:46 smithi111 bash[14162]: audit 2024-02-22T18:40:46.202368+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-22T18:40:47.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:47 smithi040 bash[13988]: cephadm 2024-02-22T18:40:46.201550+0000 mgr.y (mgr.14138) 131 : cephadm [INF] Deploying daemon osd.3 on smithi040 2024-02-22T18:40:47.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:47 smithi040 bash[13988]: cluster 2024-02-22T18:40:46.561298+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:47.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:47 smithi040 bash[17964]: cephadm 2024-02-22T18:40:46.201550+0000 mgr.y (mgr.14138) 131 : cephadm [INF] Deploying daemon osd.3 on smithi040 2024-02-22T18:40:47.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:47 smithi040 bash[17964]: cluster 2024-02-22T18:40:46.561298+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:47.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:47 smithi111 bash[14162]: cephadm 2024-02-22T18:40:46.201550+0000 mgr.y (mgr.14138) 131 : cephadm [INF] Deploying daemon osd.3 on smithi040 2024-02-22T18:40:47.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:47 smithi111 bash[14162]: cluster 2024-02-22T18:40:46.561298+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:48.442 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 3 on host 'smithi040' 2024-02-22T18:40:48.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:48 smithi040 bash[13988]: audit 2024-02-22T18:40:48.435830+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:48.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:48 smithi040 bash[13988]: audit 2024-02-22T18:40:48.439151+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:48.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:48 smithi040 bash[17964]: audit 2024-02-22T18:40:48.435830+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:48.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:48 smithi040 bash[17964]: audit 2024-02-22T18:40:48.439151+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:48.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:48 smithi111 bash[14162]: audit 2024-02-22T18:40:48.435830+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:48.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:48 smithi111 bash[14162]: audit 2024-02-22T18:40:48.439151+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:49.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:49 smithi040 bash[13988]: cephadm 2024-02-22T18:40:48.433788+0000 mgr.y (mgr.14138) 133 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:40:49.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:49 smithi040 bash[13988]: cluster 2024-02-22T18:40:48.561808+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:49 smithi040 bash[17964]: cephadm 2024-02-22T18:40:48.433788+0000 mgr.y (mgr.14138) 133 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:40:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:49 smithi040 bash[17964]: cluster 2024-02-22T18:40:48.561808+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:49.947 DEBUG:teuthology.orchestra.run.smithi040:osd.3> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.3.service 2024-02-22T18:40:49.949 INFO:tasks.cephadm:Deploying osd.4 on smithi111 with /dev/vg_nvme/lv_4... 2024-02-22T18:40:49.949 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-22T18:40:49.962 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:49 smithi111 bash[14162]: cephadm 2024-02-22T18:40:48.433788+0000 mgr.y (mgr.14138) 133 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:40:49.962 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:49 smithi111 bash[14162]: cluster 2024-02-22T18:40:48.561808+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:50.153 INFO:journalctl@ceph.osd.3.smithi040.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:40:50.846 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[25315]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-22T18:40:50.846 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[25315]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-02-22T18:40:50.846 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[25315]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2024-02-22T18:40:50.846 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[25315]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-02-22T18:40:50.846 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[25315]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-22T18:40:50.846 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[25315]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-22T18:40:50.846 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[25315]: --> ceph-volume lvm activate successful for osd ID: 3 2024-02-22T18:40:51.155 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:50 smithi111 bash[14162]: audit 2024-02-22T18:40:49.836074+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:51.155 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:50 smithi111 bash[14162]: audit 2024-02-22T18:40:49.837921+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:51.155 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:50 smithi111 bash[14162]: cluster 2024-02-22T18:40:50.562362+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:51.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[17964]: audit 2024-02-22T18:40:49.836074+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:51.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[17964]: audit 2024-02-22T18:40:49.837921+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:51.259 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[17964]: cluster 2024-02-22T18:40:50.562362+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:51.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[13988]: audit 2024-02-22T18:40:49.836074+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:51.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[13988]: audit 2024-02-22T18:40:49.837921+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:51.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:50 smithi040 bash[13988]: cluster 2024-02-22T18:40:50.562362+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:52.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:52 smithi040 bash[13988]: cluster 2024-02-22T18:40:52.562995+0000 mgr.y (mgr.14138) 136 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:52.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:52 smithi040 bash[17964]: cluster 2024-02-22T18:40:52.562995+0000 mgr.y (mgr.14138) 136 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:52.843 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-22T18:40:52.843 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-22T18:40:52.843 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-02-22T18:40:52.843 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-02-22T18:40:52.843 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0160075 s, 655 MB/s 2024-02-22T18:40:52.843 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-02-22T18:40:52.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:52 smithi111 bash[14162]: cluster 2024-02-22T18:40:52.562995+0000 mgr.y (mgr.14138) 136 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:53.427 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_4 2024-02-22T18:40:54.178 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:53 smithi040 bash[25592]: debug 2024-02-22T18:40:53.855+0000 7ff9387b7f40 -1 Falling back to public interface 2024-02-22T18:40:54.905 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:54 smithi111 bash[14162]: audit 2024-02-22T18:40:54.494270+0000 mon.a (mon.0) 383 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T18:40:54.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:54 smithi040 bash[13988]: audit 2024-02-22T18:40:54.494270+0000 mon.a (mon.0) 383 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T18:40:54.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:54 smithi040 bash[17964]: audit 2024-02-22T18:40:54.494270+0000 mon.a (mon.0) 383 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T18:40:54.928 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:54 smithi040 bash[25592]: debug 2024-02-22T18:40:54.487+0000 7ff9387b7f40 -1 osd.3 0 log_to_monitors {default=true} 2024-02-22T18:40:55.677 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[25592]: debug 2024-02-22T18:40:55.559+0000 7ff91d285700 -1 osd.3 0 waiting for initial osdmap 2024-02-22T18:40:55.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[17964]: audit 2024-02-22T18:40:54.552392+0000 mon.a (mon.0) 384 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T18:40:55.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[17964]: cluster 2024-02-22T18:40:54.552788+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-22T18:40:55.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[17964]: audit 2024-02-22T18:40:54.553745+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:55.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[17964]: audit 2024-02-22T18:40:54.554811+0000 mon.a (mon.0) 387 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:55.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[17964]: cluster 2024-02-22T18:40:54.563395+0000 mgr.y (mgr.14138) 137 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:55.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[13988]: audit 2024-02-22T18:40:54.552392+0000 mon.a (mon.0) 384 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T18:40:55.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[13988]: cluster 2024-02-22T18:40:54.552788+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-22T18:40:55.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[13988]: audit 2024-02-22T18:40:54.553745+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:55.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[13988]: audit 2024-02-22T18:40:54.554811+0000 mon.a (mon.0) 387 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:55.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:55 smithi040 bash[13988]: cluster 2024-02-22T18:40:54.563395+0000 mgr.y (mgr.14138) 137 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:55.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:55 smithi111 bash[14162]: audit 2024-02-22T18:40:54.552392+0000 mon.a (mon.0) 384 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T18:40:55.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:55 smithi111 bash[14162]: cluster 2024-02-22T18:40:54.552788+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-22T18:40:55.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:55 smithi111 bash[14162]: audit 2024-02-22T18:40:54.553745+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:55.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:55 smithi111 bash[14162]: audit 2024-02-22T18:40:54.554811+0000 mon.a (mon.0) 387 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-22T18:40:55.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:55 smithi111 bash[14162]: cluster 2024-02-22T18:40:54.563395+0000 mgr.y (mgr.14138) 137 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:56.580 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:55.556885+0000 mon.a (mon.0) 388 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:40:56.580 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: cluster 2024-02-22T18:40:55.556982+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-22T18:40:56.580 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:55.557147+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:56.580 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:55.562856+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:56.580 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:56.003647+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:40:56.581 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:56.007375+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:40:56.581 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:56.009200+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:56.581 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:56.011356+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:55.556885+0000 mon.a (mon.0) 388 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:40:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: cluster 2024-02-22T18:40:55.556982+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-22T18:40:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:55.557147+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:55.562856+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:56.003647+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:40:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:56.007375+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:40:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:56.009200+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:56.011356+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:56.157524+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:56.464484+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:56.471356+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:56.479726+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[13988]: audit 2024-02-22T18:40:56.562698+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:55.556885+0000 mon.a (mon.0) 388 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: cluster 2024-02-22T18:40:55.556982+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:55.557147+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:55.562856+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:56.003647+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:40:56.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:56.007375+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:40:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:56.009200+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:40:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:56.011356+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:40:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:56.157524+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:56.464484+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:56.471356+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:56.479726+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:56 smithi040 bash[17964]: audit 2024-02-22T18:40:56.562698+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:56.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:56.157524+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:40:56.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:56.464484+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:56.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:56.471356+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:56.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:56.479726+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:40:56.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:56 smithi111 bash[14162]: audit 2024-02-22T18:40:56.562698+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:57.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:57 smithi111 bash[14162]: cluster 2024-02-22T18:40:55.480940+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:40:57.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:57 smithi111 bash[14162]: cluster 2024-02-22T18:40:55.481007+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:40:57.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:57 smithi111 bash[14162]: audit 2024-02-22T18:40:56.001729+0000 mgr.y (mgr.14138) 138 : audit [DBG] from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:40:57.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:57 smithi111 bash[14162]: cephadm 2024-02-22T18:40:56.006833+0000 mgr.y (mgr.14138) 139 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:40:57.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:57 smithi111 bash[14162]: cluster 2024-02-22T18:40:56.563855+0000 mgr.y (mgr.14138) 140 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:57.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:57 smithi111 bash[14162]: cluster 2024-02-22T18:40:56.571850+0000 mon.a (mon.0) 401 : cluster [INF] osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731] boot 2024-02-22T18:40:57.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:57 smithi111 bash[14162]: cluster 2024-02-22T18:40:56.571935+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-22T18:40:57.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:57 smithi111 bash[14162]: audit 2024-02-22T18:40:56.573135+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[13988]: cluster 2024-02-22T18:40:55.480940+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:40:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[13988]: cluster 2024-02-22T18:40:55.481007+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:40:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[13988]: audit 2024-02-22T18:40:56.001729+0000 mgr.y (mgr.14138) 138 : audit [DBG] from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:40:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[13988]: cephadm 2024-02-22T18:40:56.006833+0000 mgr.y (mgr.14138) 139 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:40:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[13988]: cluster 2024-02-22T18:40:56.563855+0000 mgr.y (mgr.14138) 140 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[13988]: cluster 2024-02-22T18:40:56.571850+0000 mon.a (mon.0) 401 : cluster [INF] osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731] boot 2024-02-22T18:40:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[13988]: cluster 2024-02-22T18:40:56.571935+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-22T18:40:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[13988]: audit 2024-02-22T18:40:56.573135+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[17964]: cluster 2024-02-22T18:40:55.480940+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:40:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[17964]: cluster 2024-02-22T18:40:55.481007+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:40:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[17964]: audit 2024-02-22T18:40:56.001729+0000 mgr.y (mgr.14138) 138 : audit [DBG] from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:40:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[17964]: cephadm 2024-02-22T18:40:56.006833+0000 mgr.y (mgr.14138) 139 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:40:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[17964]: cluster 2024-02-22T18:40:56.563855+0000 mgr.y (mgr.14138) 140 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 265 GiB / 268 GiB avail 2024-02-22T18:40:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[17964]: cluster 2024-02-22T18:40:56.571850+0000 mon.a (mon.0) 401 : cluster [INF] osd.3 [v2:172.21.15.40:6826/3447321731,v1:172.21.15.40:6827/3447321731] boot 2024-02-22T18:40:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[17964]: cluster 2024-02-22T18:40:56.571935+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-22T18:40:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:57 smithi040 bash[17964]: audit 2024-02-22T18:40:56.573135+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:40:58.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:58 smithi040 bash[13988]: cluster 2024-02-22T18:40:57.587367+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-22T18:40:58.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:58 smithi040 bash[17964]: cluster 2024-02-22T18:40:57.587367+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-22T18:40:58.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:58 smithi111 bash[14162]: cluster 2024-02-22T18:40:57.587367+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-22T18:40:59.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[13988]: cluster 2024-02-22T18:40:58.564411+0000 mgr.y (mgr.14138) 141 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 832 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:40:59.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[13988]: audit 2024-02-22T18:40:59.401433+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.111:0/1000962131' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64699f72-f560-4205-93e5-ce6cc4ee34d2"}]: dispatch 2024-02-22T18:40:59.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[13988]: audit 2024-02-22T18:40:59.401619+0000 mon.a (mon.0) 405 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64699f72-f560-4205-93e5-ce6cc4ee34d2"}]: dispatch 2024-02-22T18:40:59.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[13988]: audit 2024-02-22T18:40:59.410258+0000 mon.a (mon.0) 406 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64699f72-f560-4205-93e5-ce6cc4ee34d2"}]': finished 2024-02-22T18:40:59.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[13988]: cluster 2024-02-22T18:40:59.410453+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-22T18:40:59.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[13988]: audit 2024-02-22T18:40:59.410678+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:40:59.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[17964]: cluster 2024-02-22T18:40:58.564411+0000 mgr.y (mgr.14138) 141 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 832 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:40:59.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[17964]: audit 2024-02-22T18:40:59.401433+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.111:0/1000962131' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64699f72-f560-4205-93e5-ce6cc4ee34d2"}]: dispatch 2024-02-22T18:40:59.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[17964]: audit 2024-02-22T18:40:59.401619+0000 mon.a (mon.0) 405 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64699f72-f560-4205-93e5-ce6cc4ee34d2"}]: dispatch 2024-02-22T18:40:59.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[17964]: audit 2024-02-22T18:40:59.410258+0000 mon.a (mon.0) 406 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64699f72-f560-4205-93e5-ce6cc4ee34d2"}]': finished 2024-02-22T18:40:59.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[17964]: cluster 2024-02-22T18:40:59.410453+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-22T18:40:59.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:40:59 smithi040 bash[17964]: audit 2024-02-22T18:40:59.410678+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:40:59.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:59 smithi111 bash[14162]: cluster 2024-02-22T18:40:58.564411+0000 mgr.y (mgr.14138) 141 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 832 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:40:59.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:59 smithi111 bash[14162]: audit 2024-02-22T18:40:59.401433+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.111:0/1000962131' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64699f72-f560-4205-93e5-ce6cc4ee34d2"}]: dispatch 2024-02-22T18:40:59.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:59 smithi111 bash[14162]: audit 2024-02-22T18:40:59.401619+0000 mon.a (mon.0) 405 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64699f72-f560-4205-93e5-ce6cc4ee34d2"}]: dispatch 2024-02-22T18:40:59.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:59 smithi111 bash[14162]: audit 2024-02-22T18:40:59.410258+0000 mon.a (mon.0) 406 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64699f72-f560-4205-93e5-ce6cc4ee34d2"}]': finished 2024-02-22T18:40:59.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:59 smithi111 bash[14162]: cluster 2024-02-22T18:40:59.410453+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-22T18:40:59.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:40:59 smithi111 bash[14162]: audit 2024-02-22T18:40:59.410678+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:00.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:00 smithi040 bash[13988]: audit 2024-02-22T18:40:59.977786+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.111:0/3520088679' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:41:00.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:00 smithi040 bash[17964]: audit 2024-02-22T18:40:59.977786+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.111:0/3520088679' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:41:00.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:00 smithi111 bash[14162]: audit 2024-02-22T18:40:59.977786+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.111:0/3520088679' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:41:01.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:01 smithi040 bash[13988]: cluster 2024-02-22T18:41:00.564966+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:01.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:01 smithi040 bash[17964]: cluster 2024-02-22T18:41:00.564966+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:01.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:01 smithi111 bash[14162]: cluster 2024-02-22T18:41:00.564966+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:02.895 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:02 smithi040 bash[13988]: cluster 2024-02-22T18:41:02.565569+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 952 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:02.895 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:02 smithi040 bash[17964]: cluster 2024-02-22T18:41:02.565569+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 952 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:02.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:02 smithi111 bash[14162]: cluster 2024-02-22T18:41:02.565569+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 952 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:03.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:03 smithi040 bash[13988]: audit 2024-02-22T18:41:02.689702+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:03.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:03 smithi040 bash[17964]: audit 2024-02-22T18:41:02.689702+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:03.962 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:03 smithi111 bash[14162]: audit 2024-02-22T18:41:02.689702+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:04.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:04 smithi111 bash[14162]: cluster 2024-02-22T18:41:04.566120+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 952 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:04.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:04 smithi040 bash[13988]: cluster 2024-02-22T18:41:04.566120+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 952 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:04.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:04 smithi040 bash[17964]: cluster 2024-02-22T18:41:04.566120+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 952 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:06.304 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:06 smithi111 bash[14162]: audit 2024-02-22T18:41:05.984332+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T18:41:06.304 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:06 smithi111 bash[14162]: audit 2024-02-22T18:41:05.986184+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:06.304 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:06 smithi111 bash[14162]: audit 2024-02-22T18:41:05.988416+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-22T18:41:06.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:06 smithi040 bash[13988]: audit 2024-02-22T18:41:05.984332+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T18:41:06.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:06 smithi040 bash[13988]: audit 2024-02-22T18:41:05.986184+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:06.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:06 smithi040 bash[13988]: audit 2024-02-22T18:41:05.988416+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-22T18:41:06.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:06 smithi040 bash[17964]: audit 2024-02-22T18:41:05.984332+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T18:41:06.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:06 smithi040 bash[17964]: audit 2024-02-22T18:41:05.986184+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:06.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:06 smithi040 bash[17964]: audit 2024-02-22T18:41:05.988416+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-22T18:41:07.926 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:07 smithi111 bash[14162]: cephadm 2024-02-22T18:41:05.987681+0000 mgr.y (mgr.14138) 145 : cephadm [INF] Deploying daemon osd.4 on smithi111 2024-02-22T18:41:07.926 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:07 smithi111 bash[14162]: cluster 2024-02-22T18:41:06.566678+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:07 smithi040 bash[13988]: cephadm 2024-02-22T18:41:05.987681+0000 mgr.y (mgr.14138) 145 : cephadm [INF] Deploying daemon osd.4 on smithi111 2024-02-22T18:41:07.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:07 smithi040 bash[13988]: cluster 2024-02-22T18:41:06.566678+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:07.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:07 smithi040 bash[17964]: cephadm 2024-02-22T18:41:05.987681+0000 mgr.y (mgr.14138) 145 : cephadm [INF] Deploying daemon osd.4 on smithi111 2024-02-22T18:41:07.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:07 smithi040 bash[17964]: cluster 2024-02-22T18:41:06.566678+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:08.154 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 4 on host 'smithi111' 2024-02-22T18:41:08.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:08 smithi040 bash[17964]: audit 2024-02-22T18:41:08.142020+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:08.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:08 smithi040 bash[17964]: audit 2024-02-22T18:41:08.147462+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:08.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:08 smithi040 bash[13988]: audit 2024-02-22T18:41:08.142020+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:08.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:08 smithi040 bash[13988]: audit 2024-02-22T18:41:08.147462+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:08.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:08 smithi111 bash[14162]: audit 2024-02-22T18:41:08.142020+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:08.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:08 smithi111 bash[14162]: audit 2024-02-22T18:41:08.147462+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:09.377 DEBUG:teuthology.orchestra.run.smithi111:osd.4> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.4.service 2024-02-22T18:41:09.379 INFO:tasks.cephadm:Deploying osd.5 on smithi111 with /dev/vg_nvme/lv_3... 2024-02-22T18:41:09.379 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-22T18:41:09.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[14162]: cluster 2024-02-22T18:41:08.567255+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:09.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[14162]: audit 2024-02-22T18:41:09.270999+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:09.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[14162]: audit 2024-02-22T18:41:09.273250+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:09.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:09 smithi040 bash[13988]: cluster 2024-02-22T18:41:08.567255+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:09.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:09 smithi040 bash[13988]: audit 2024-02-22T18:41:09.270999+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:09.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:09 smithi040 bash[13988]: audit 2024-02-22T18:41:09.273250+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:09.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:09 smithi040 bash[17964]: cluster 2024-02-22T18:41:08.567255+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:09.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:09 smithi040 bash[17964]: audit 2024-02-22T18:41:09.270999+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:09.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:09 smithi040 bash[17964]: audit 2024-02-22T18:41:09.273250+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:11.004 INFO:journalctl@ceph.osd.4.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:41:11.004 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[16204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-22T18:41:11.004 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[16204]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-02-22T18:41:11.004 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[16204]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2024-02-22T18:41:11.004 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[16204]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-02-22T18:41:11.004 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[16204]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-22T18:41:11.004 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[16204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-22T18:41:11.005 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:09 smithi111 bash[16204]: --> ceph-volume lvm activate successful for osd ID: 4 2024-02-22T18:41:11.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:11 smithi040 bash[13988]: cluster 2024-02-22T18:41:10.567786+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:11.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:11 smithi040 bash[17964]: cluster 2024-02-22T18:41:10.567786+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:11.931 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:11 smithi111 bash[14162]: cluster 2024-02-22T18:41:10.567786+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:13.464 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:13 smithi111 bash[16437]: debug 2024-02-22T18:41:13.033+0000 7f11a9c9bf40 -1 Falling back to public interface 2024-02-22T18:41:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:13 smithi040 bash[13988]: cluster 2024-02-22T18:41:12.568370+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:13 smithi040 bash[17964]: cluster 2024-02-22T18:41:12.568370+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:13.998 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:13 smithi111 bash[14162]: cluster 2024-02-22T18:41:12.568370+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:13.998 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:13 smithi111 bash[16437]: debug 2024-02-22T18:41:13.677+0000 7f11a9c9bf40 -1 osd.4 0 log_to_monitors {default=true} 2024-02-22T18:41:14.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:14 smithi040 bash[13988]: audit 2024-02-22T18:41:13.690778+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.111:6800/1993784371,v1:172.21.15.111:6801/1993784371]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T18:41:14.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:14 smithi040 bash[13988]: audit 2024-02-22T18:41:13.690922+0000 mon.a (mon.0) 417 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T18:41:14.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:14 smithi040 bash[17964]: audit 2024-02-22T18:41:13.690778+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.111:6800/1993784371,v1:172.21.15.111:6801/1993784371]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T18:41:14.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:14 smithi040 bash[17964]: audit 2024-02-22T18:41:13.690922+0000 mon.a (mon.0) 417 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T18:41:14.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:14 smithi111 bash[14162]: audit 2024-02-22T18:41:13.690778+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.111:6800/1993784371,v1:172.21.15.111:6801/1993784371]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T18:41:14.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:14 smithi111 bash[14162]: audit 2024-02-22T18:41:13.690922+0000 mon.a (mon.0) 417 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T18:41:15.127 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-22T18:41:15.127 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-22T18:41:15.127 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-02-22T18:41:15.127 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-02-22T18:41:15.127 INFO:teuthology.orchestra.run.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0187906 s, 558 MB/s 2024-02-22T18:41:15.127 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-02-22T18:41:15.744 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_3 2024-02-22T18:41:15.889 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 18:41:15 smithi111 bash[16437]: debug 2024-02-22T18:41:15.613+0000 7f1192771700 -1 osd.4 0 waiting for initial osdmap 2024-02-22T18:41:15.889 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:15 smithi111 bash[14162]: cluster 2024-02-22T18:41:14.568903+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:15.889 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:15 smithi111 bash[14162]: audit 2024-02-22T18:41:14.604166+0000 mon.a (mon.0) 418 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T18:41:15.889 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:15 smithi111 bash[14162]: cluster 2024-02-22T18:41:14.604434+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-22T18:41:15.889 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:15 smithi111 bash[14162]: audit 2024-02-22T18:41:14.604587+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:15.889 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:15 smithi111 bash[14162]: audit 2024-02-22T18:41:14.606181+0000 mon.a (mon.0) 421 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:15.890 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:15 smithi111 bash[14162]: audit 2024-02-22T18:41:14.606329+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.111:6800/1993784371,v1:172.21.15.111:6801/1993784371]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:15.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[13988]: cluster 2024-02-22T18:41:14.568903+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:15.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[13988]: audit 2024-02-22T18:41:14.604166+0000 mon.a (mon.0) 418 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T18:41:15.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[13988]: cluster 2024-02-22T18:41:14.604434+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-22T18:41:15.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[13988]: audit 2024-02-22T18:41:14.604587+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:15.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[13988]: audit 2024-02-22T18:41:14.606181+0000 mon.a (mon.0) 421 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:15.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[13988]: audit 2024-02-22T18:41:14.606329+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.111:6800/1993784371,v1:172.21.15.111:6801/1993784371]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:15.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[17964]: cluster 2024-02-22T18:41:14.568903+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:15.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[17964]: audit 2024-02-22T18:41:14.604166+0000 mon.a (mon.0) 418 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T18:41:15.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[17964]: cluster 2024-02-22T18:41:14.604434+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-22T18:41:15.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[17964]: audit 2024-02-22T18:41:14.604587+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:15.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[17964]: audit 2024-02-22T18:41:14.606181+0000 mon.a (mon.0) 421 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:15.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:15 smithi040 bash[17964]: audit 2024-02-22T18:41:14.606329+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.111:6800/1993784371,v1:172.21.15.111:6801/1993784371]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:16.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[17964]: audit 2024-02-22T18:41:15.607879+0000 mon.a (mon.0) 422 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:41:16.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[17964]: cluster 2024-02-22T18:41:15.608151+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-22T18:41:16.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[17964]: audit 2024-02-22T18:41:15.609089+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:16.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[17964]: audit 2024-02-22T18:41:15.616703+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:16.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[17964]: cluster 2024-02-22T18:41:16.569438+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:16.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[13988]: audit 2024-02-22T18:41:15.607879+0000 mon.a (mon.0) 422 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:41:16.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[13988]: cluster 2024-02-22T18:41:15.608151+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-22T18:41:16.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[13988]: audit 2024-02-22T18:41:15.609089+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:16.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[13988]: audit 2024-02-22T18:41:15.616703+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:16.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:16 smithi040 bash[13988]: cluster 2024-02-22T18:41:16.569438+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:16.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:16 smithi111 bash[14162]: audit 2024-02-22T18:41:15.607879+0000 mon.a (mon.0) 422 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:41:17.553 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:16 smithi111 bash[14162]: cluster 2024-02-22T18:41:15.608151+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-22T18:41:17.553 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:16 smithi111 bash[14162]: audit 2024-02-22T18:41:15.609089+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:17.553 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:16 smithi111 bash[14162]: audit 2024-02-22T18:41:15.616703+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:17.553 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:16 smithi111 bash[14162]: cluster 2024-02-22T18:41:16.569438+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: cluster 2024-02-22T18:41:14.677469+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: cluster 2024-02-22T18:41:14.677542+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: cluster 2024-02-22T18:41:16.620027+0000 mon.a (mon.0) 426 : cluster [INF] osd.4 [v2:172.21.15.111:6800/1993784371,v1:172.21.15.111:6801/1993784371] boot 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: cluster 2024-02-22T18:41:16.620317+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: audit 2024-02-22T18:41:16.621891+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: audit 2024-02-22T18:41:17.196790+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: audit 2024-02-22T18:41:17.511890+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: audit 2024-02-22T18:41:17.519649+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: cephadm 2024-02-22T18:41:17.522644+0000 mgr.y (mgr.14138) 152 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:41:17.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:17 smithi111 bash[14162]: cluster 2024-02-22T18:41:17.621201+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-22T18:41:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: cluster 2024-02-22T18:41:14.677469+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:41:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: cluster 2024-02-22T18:41:14.677542+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:41:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: cluster 2024-02-22T18:41:16.620027+0000 mon.a (mon.0) 426 : cluster [INF] osd.4 [v2:172.21.15.111:6800/1993784371,v1:172.21.15.111:6801/1993784371] boot 2024-02-22T18:41:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: cluster 2024-02-22T18:41:16.620317+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-22T18:41:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: audit 2024-02-22T18:41:16.621891+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: audit 2024-02-22T18:41:17.196790+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: audit 2024-02-22T18:41:17.511890+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: audit 2024-02-22T18:41:17.519649+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: cephadm 2024-02-22T18:41:17.522644+0000 mgr.y (mgr.14138) 152 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[13988]: cluster 2024-02-22T18:41:17.621201+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: cluster 2024-02-22T18:41:14.677469+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: cluster 2024-02-22T18:41:14.677542+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: cluster 2024-02-22T18:41:16.620027+0000 mon.a (mon.0) 426 : cluster [INF] osd.4 [v2:172.21.15.111:6800/1993784371,v1:172.21.15.111:6801/1993784371] boot 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: cluster 2024-02-22T18:41:16.620317+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: audit 2024-02-22T18:41:16.621891+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: audit 2024-02-22T18:41:17.196790+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: audit 2024-02-22T18:41:17.511890+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: audit 2024-02-22T18:41:17.519649+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: cephadm 2024-02-22T18:41:17.522644+0000 mgr.y (mgr.14138) 152 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:41:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:17 smithi040 bash[17964]: cluster 2024-02-22T18:41:17.621201+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-22T18:41:19.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:18 smithi040 bash[13988]: audit 2024-02-22T18:41:17.876587+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:19.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:18 smithi040 bash[13988]: cluster 2024-02-22T18:41:18.569970+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:19.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:18 smithi040 bash[17964]: audit 2024-02-22T18:41:17.876587+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:19.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:18 smithi040 bash[17964]: cluster 2024-02-22T18:41:18.569970+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:19.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:18 smithi111 bash[14162]: audit 2024-02-22T18:41:17.876587+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:19.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:18 smithi111 bash[14162]: cluster 2024-02-22T18:41:18.569970+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:20.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[13988]: audit 2024-02-22T18:41:18.945042+0000 mgr.y (mgr.14138) 154 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:41:20.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[13988]: audit 2024-02-22T18:41:18.946892+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:41:20.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[13988]: cephadm 2024-02-22T18:41:18.949648+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:41:20.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[13988]: audit 2024-02-22T18:41:18.950167+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:41:20.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[13988]: audit 2024-02-22T18:41:18.951929+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:20.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[13988]: audit 2024-02-22T18:41:18.953809+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:20.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[17964]: audit 2024-02-22T18:41:18.945042+0000 mgr.y (mgr.14138) 154 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:41:20.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[17964]: audit 2024-02-22T18:41:18.946892+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:41:20.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[17964]: cephadm 2024-02-22T18:41:18.949648+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:41:20.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[17964]: audit 2024-02-22T18:41:18.950167+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:41:20.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[17964]: audit 2024-02-22T18:41:18.951929+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:20.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:19 smithi040 bash[17964]: audit 2024-02-22T18:41:18.953809+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:20.209 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:19 smithi111 bash[14162]: audit 2024-02-22T18:41:18.945042+0000 mgr.y (mgr.14138) 154 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:41:20.209 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:19 smithi111 bash[14162]: audit 2024-02-22T18:41:18.946892+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:41:20.210 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:19 smithi111 bash[14162]: cephadm 2024-02-22T18:41:18.949648+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:41:20.210 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:19 smithi111 bash[14162]: audit 2024-02-22T18:41:18.950167+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:41:20.210 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:19 smithi111 bash[14162]: audit 2024-02-22T18:41:18.951929+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:20.210 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:19 smithi111 bash[14162]: audit 2024-02-22T18:41:18.953809+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:21.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:20 smithi040 bash[13988]: cluster 2024-02-22T18:41:20.570534+0000 mgr.y (mgr.14138) 156 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:21.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:20 smithi040 bash[17964]: cluster 2024-02-22T18:41:20.570534+0000 mgr.y (mgr.14138) 156 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:21.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:20 smithi111 bash[14162]: cluster 2024-02-22T18:41:20.570534+0000 mgr.y (mgr.14138) 156 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:22.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[17964]: audit 2024-02-22T18:41:22.103286+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.111:0/669226443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f071be67-ae85-4824-ba99-0ffec0951e50"}]: dispatch 2024-02-22T18:41:22.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[17964]: audit 2024-02-22T18:41:22.103384+0000 mon.a (mon.0) 438 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f071be67-ae85-4824-ba99-0ffec0951e50"}]: dispatch 2024-02-22T18:41:22.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[17964]: audit 2024-02-22T18:41:22.111974+0000 mon.a (mon.0) 439 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f071be67-ae85-4824-ba99-0ffec0951e50"}]': finished 2024-02-22T18:41:22.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[17964]: cluster 2024-02-22T18:41:22.112232+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-22T18:41:22.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[17964]: audit 2024-02-22T18:41:22.112477+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:22.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[13988]: audit 2024-02-22T18:41:22.103286+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.111:0/669226443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f071be67-ae85-4824-ba99-0ffec0951e50"}]: dispatch 2024-02-22T18:41:22.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[13988]: audit 2024-02-22T18:41:22.103384+0000 mon.a (mon.0) 438 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f071be67-ae85-4824-ba99-0ffec0951e50"}]: dispatch 2024-02-22T18:41:22.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[13988]: audit 2024-02-22T18:41:22.111974+0000 mon.a (mon.0) 439 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f071be67-ae85-4824-ba99-0ffec0951e50"}]': finished 2024-02-22T18:41:22.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[13988]: cluster 2024-02-22T18:41:22.112232+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-22T18:41:22.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:22 smithi040 bash[13988]: audit 2024-02-22T18:41:22.112477+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:22.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:22 smithi111 bash[14162]: audit 2024-02-22T18:41:22.103286+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.111:0/669226443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f071be67-ae85-4824-ba99-0ffec0951e50"}]: dispatch 2024-02-22T18:41:22.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:22 smithi111 bash[14162]: audit 2024-02-22T18:41:22.103384+0000 mon.a (mon.0) 438 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f071be67-ae85-4824-ba99-0ffec0951e50"}]: dispatch 2024-02-22T18:41:22.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:22 smithi111 bash[14162]: audit 2024-02-22T18:41:22.111974+0000 mon.a (mon.0) 439 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f071be67-ae85-4824-ba99-0ffec0951e50"}]': finished 2024-02-22T18:41:22.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:22 smithi111 bash[14162]: cluster 2024-02-22T18:41:22.112232+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-22T18:41:22.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:22 smithi111 bash[14162]: audit 2024-02-22T18:41:22.112477+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:23.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:23 smithi040 bash[13988]: cluster 2024-02-22T18:41:22.571079+0000 mgr.y (mgr.14138) 157 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:23.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:23 smithi040 bash[13988]: audit 2024-02-22T18:41:22.685203+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.111:0/3927472922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:41:23.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:23 smithi040 bash[17964]: cluster 2024-02-22T18:41:22.571079+0000 mgr.y (mgr.14138) 157 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:23.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:23 smithi040 bash[17964]: audit 2024-02-22T18:41:22.685203+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.111:0/3927472922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:41:23.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:23 smithi111 bash[14162]: cluster 2024-02-22T18:41:22.571079+0000 mgr.y (mgr.14138) 157 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:23.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:23 smithi111 bash[14162]: audit 2024-02-22T18:41:22.685203+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.111:0/3927472922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:41:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:25 smithi040 bash[13988]: cluster 2024-02-22T18:41:24.571671+0000 mgr.y (mgr.14138) 158 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:25 smithi040 bash[13988]: audit 2024-02-22T18:41:25.445918+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:25.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:25 smithi040 bash[17964]: cluster 2024-02-22T18:41:24.571671+0000 mgr.y (mgr.14138) 158 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:25.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:25 smithi040 bash[17964]: audit 2024-02-22T18:41:25.445918+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:25.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:25 smithi111 bash[14162]: cluster 2024-02-22T18:41:24.571671+0000 mgr.y (mgr.14138) 158 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:25.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:25 smithi111 bash[14162]: audit 2024-02-22T18:41:25.445918+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:27.880 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:27 smithi111 bash[14162]: cluster 2024-02-22T18:41:26.572242+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:27.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:27 smithi040 bash[13988]: cluster 2024-02-22T18:41:26.572242+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:27.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:27 smithi040 bash[17964]: cluster 2024-02-22T18:41:26.572242+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:29.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:29 smithi040 bash[13988]: cluster 2024-02-22T18:41:28.572871+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:29.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:29 smithi040 bash[13988]: audit 2024-02-22T18:41:28.902324+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T18:41:29.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:29 smithi040 bash[13988]: audit 2024-02-22T18:41:28.904282+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:29.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:29 smithi040 bash[13988]: audit 2024-02-22T18:41:28.906489+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-22T18:41:29.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:29 smithi040 bash[17964]: cluster 2024-02-22T18:41:28.572871+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:29.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:29 smithi040 bash[17964]: audit 2024-02-22T18:41:28.902324+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T18:41:29.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:29 smithi040 bash[17964]: audit 2024-02-22T18:41:28.904282+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:29.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:29 smithi040 bash[17964]: audit 2024-02-22T18:41:28.906489+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-22T18:41:29.955 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:29 smithi111 bash[14162]: cluster 2024-02-22T18:41:28.572871+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:29.955 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:29 smithi111 bash[14162]: audit 2024-02-22T18:41:28.902324+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T18:41:29.955 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:29 smithi111 bash[14162]: audit 2024-02-22T18:41:28.904282+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:29.955 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:29 smithi111 bash[14162]: audit 2024-02-22T18:41:28.906489+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-22T18:41:30.903 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:30 smithi111 bash[14162]: cephadm 2024-02-22T18:41:28.905784+0000 mgr.y (mgr.14138) 161 : cephadm [INF] Deploying daemon osd.5 on smithi111 2024-02-22T18:41:30.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:30 smithi040 bash[13988]: cephadm 2024-02-22T18:41:28.905784+0000 mgr.y (mgr.14138) 161 : cephadm [INF] Deploying daemon osd.5 on smithi111 2024-02-22T18:41:30.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:30 smithi040 bash[17964]: cephadm 2024-02-22T18:41:28.905784+0000 mgr.y (mgr.14138) 161 : cephadm [INF] Deploying daemon osd.5 on smithi111 2024-02-22T18:41:30.937 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 5 on host 'smithi111' 2024-02-22T18:41:31.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:31 smithi040 bash[13988]: cluster 2024-02-22T18:41:30.573429+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:31.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:31 smithi040 bash[13988]: audit 2024-02-22T18:41:30.924453+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:31.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:31 smithi040 bash[13988]: audit 2024-02-22T18:41:30.929397+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:31.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:31 smithi040 bash[17964]: cluster 2024-02-22T18:41:30.573429+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:31.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:31 smithi040 bash[17964]: audit 2024-02-22T18:41:30.924453+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:31.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:31 smithi040 bash[17964]: audit 2024-02-22T18:41:30.929397+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:31.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:31 smithi111 bash[14162]: cluster 2024-02-22T18:41:30.573429+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:31.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:31 smithi111 bash[14162]: audit 2024-02-22T18:41:30.924453+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:31.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:31 smithi111 bash[14162]: audit 2024-02-22T18:41:30.929397+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:32.456 DEBUG:teuthology.orchestra.run.smithi111:osd.5> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.5.service 2024-02-22T18:41:32.459 INFO:tasks.cephadm:Deploying osd.6 on smithi111 with /dev/vg_nvme/lv_2... 2024-02-22T18:41:32.459 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-22T18:41:32.941 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:32 smithi111 bash[14162]: audit 2024-02-22T18:41:31.750320+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:32.941 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:32 smithi111 bash[14162]: audit 2024-02-22T18:41:31.751832+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:32.941 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:32 smithi111 bash[14162]: cluster 2024-02-22T18:41:32.574016+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:32.941 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:32 smithi111 bash[14162]: audit 2024-02-22T18:41:32.721328+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:33.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:32 smithi040 bash[13988]: audit 2024-02-22T18:41:31.750320+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:33.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:32 smithi040 bash[13988]: audit 2024-02-22T18:41:31.751832+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:33.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:32 smithi040 bash[13988]: cluster 2024-02-22T18:41:32.574016+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:33.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:32 smithi040 bash[13988]: audit 2024-02-22T18:41:32.721328+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:33.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:32 smithi040 bash[17964]: audit 2024-02-22T18:41:31.750320+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:33.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:32 smithi040 bash[17964]: audit 2024-02-22T18:41:31.751832+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:33.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:32 smithi040 bash[17964]: cluster 2024-02-22T18:41:32.574016+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:33.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:32 smithi040 bash[17964]: audit 2024-02-22T18:41:32.721328+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:33.184 INFO:journalctl@ceph.osd.5.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:41:33.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:33 smithi111 bash[17821]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-22T18:41:33.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:33 smithi111 bash[17821]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-02-22T18:41:33.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:33 smithi111 bash[17821]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2024-02-22T18:41:33.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:33 smithi111 bash[17821]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-02-22T18:41:33.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:33 smithi111 bash[17821]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-22T18:41:33.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:33 smithi111 bash[17821]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-22T18:41:33.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:33 smithi111 bash[17821]: --> ceph-volume lvm activate successful for osd ID: 5 2024-02-22T18:41:34.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:34 smithi111 bash[14162]: cluster 2024-02-22T18:41:34.574675+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:34.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:34 smithi040 bash[13988]: cluster 2024-02-22T18:41:34.574675+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:34.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:34 smithi040 bash[17964]: cluster 2024-02-22T18:41:34.574675+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:37.145 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:36 smithi111 bash[18181]: debug 2024-02-22T18:41:36.973+0000 7fed79896f40 1 --2- 172.21.15.111:0/1229187901 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56217a6ed000 0x56217a65fe00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x56217a68a240 tx=0x56217a6aa420).stop 2024-02-22T18:41:37.817 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-22T18:41:37.818 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-22T18:41:37.818 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-02-22T18:41:37.818 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-02-22T18:41:37.818 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0227732 s, 460 MB/s 2024-02-22T18:41:37.818 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-02-22T18:41:37.858 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:37 smithi111 bash[18181]: debug 2024-02-22T18:41:37.525+0000 7fed79896f40 -1 Falling back to public interface 2024-02-22T18:41:37.858 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:37 smithi111 bash[14162]: cluster 2024-02-22T18:41:36.575300+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:37.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:37 smithi040 bash[17964]: cluster 2024-02-22T18:41:36.575300+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:37.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:37 smithi040 bash[13988]: cluster 2024-02-22T18:41:36.575300+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:38.453 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:38 smithi111 bash[18181]: debug 2024-02-22T18:41:38.189+0000 7fed79896f40 -1 osd.5 0 log_to_monitors {default=true} 2024-02-22T18:41:38.454 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_2 2024-02-22T18:41:38.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:38 smithi111 bash[14162]: audit 2024-02-22T18:41:38.196730+0000 mon.a (mon.0) 451 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T18:41:38.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:38 smithi111 bash[14162]: audit 2024-02-22T18:41:38.196804+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.111:6808/3520287861,v1:172.21.15.111:6809/3520287861]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T18:41:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:38 smithi040 bash[13988]: audit 2024-02-22T18:41:38.196730+0000 mon.a (mon.0) 451 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T18:41:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:38 smithi040 bash[13988]: audit 2024-02-22T18:41:38.196804+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.111:6808/3520287861,v1:172.21.15.111:6809/3520287861]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T18:41:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:38 smithi040 bash[17964]: audit 2024-02-22T18:41:38.196730+0000 mon.a (mon.0) 451 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T18:41:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:38 smithi040 bash[17964]: audit 2024-02-22T18:41:38.196804+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.111:6808/3520287861,v1:172.21.15.111:6809/3520287861]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T18:41:39.631 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[18181]: debug 2024-02-22T18:41:39.609+0000 7fed6236c700 -1 osd.5 0 waiting for initial osdmap 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: cluster 2024-02-22T18:41:38.575867+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: audit 2024-02-22T18:41:38.593623+0000 mon.a (mon.0) 452 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: cluster 2024-02-22T18:41:38.593711+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: audit 2024-02-22T18:41:38.593870+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: audit 2024-02-22T18:41:38.596521+0000 mon.a (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: audit 2024-02-22T18:41:38.596758+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.111:6808/3520287861,v1:172.21.15.111:6809/3520287861]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: audit 2024-02-22T18:41:39.151276+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: audit 2024-02-22T18:41:39.464282+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: audit 2024-02-22T18:41:39.473968+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:39.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:39 smithi111 bash[14162]: audit 2024-02-22T18:41:39.485556+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:39.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: cluster 2024-02-22T18:41:38.575867+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:39.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: audit 2024-02-22T18:41:38.593623+0000 mon.a (mon.0) 452 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T18:41:39.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: cluster 2024-02-22T18:41:38.593711+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: audit 2024-02-22T18:41:38.593870+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: audit 2024-02-22T18:41:38.596521+0000 mon.a (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: audit 2024-02-22T18:41:38.596758+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.111:6808/3520287861,v1:172.21.15.111:6809/3520287861]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: audit 2024-02-22T18:41:39.151276+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: audit 2024-02-22T18:41:39.464282+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: audit 2024-02-22T18:41:39.473968+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[13988]: audit 2024-02-22T18:41:39.485556+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: cluster 2024-02-22T18:41:38.575867+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: audit 2024-02-22T18:41:38.593623+0000 mon.a (mon.0) 452 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T18:41:39.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: cluster 2024-02-22T18:41:38.593711+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-22T18:41:39.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: audit 2024-02-22T18:41:38.593870+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:39.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: audit 2024-02-22T18:41:38.596521+0000 mon.a (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:39.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: audit 2024-02-22T18:41:38.596758+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.111:6808/3520287861,v1:172.21.15.111:6809/3520287861]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:41:39.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: audit 2024-02-22T18:41:39.151276+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:39.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: audit 2024-02-22T18:41:39.464282+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:39.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: audit 2024-02-22T18:41:39.473968+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:39.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:39 smithi040 bash[17964]: audit 2024-02-22T18:41:39.485556+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:40.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[17964]: audit 2024-02-22T18:41:39.601022+0000 mon.a (mon.0) 460 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:41:40.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[17964]: cluster 2024-02-22T18:41:39.601206+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-22T18:41:40.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[17964]: audit 2024-02-22T18:41:39.602325+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:40.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[17964]: audit 2024-02-22T18:41:39.610538+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[17964]: cluster 2024-02-22T18:41:40.602918+0000 mon.a (mon.0) 464 : cluster [INF] osd.5 [v2:172.21.15.111:6808/3520287861,v1:172.21.15.111:6809/3520287861] boot 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[17964]: cluster 2024-02-22T18:41:40.603017+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[17964]: audit 2024-02-22T18:41:40.603316+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[13988]: audit 2024-02-22T18:41:39.601022+0000 mon.a (mon.0) 460 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[13988]: cluster 2024-02-22T18:41:39.601206+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[13988]: audit 2024-02-22T18:41:39.602325+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[13988]: audit 2024-02-22T18:41:39.610538+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[13988]: cluster 2024-02-22T18:41:40.602918+0000 mon.a (mon.0) 464 : cluster [INF] osd.5 [v2:172.21.15.111:6808/3520287861,v1:172.21.15.111:6809/3520287861] boot 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[13988]: cluster 2024-02-22T18:41:40.603017+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-22T18:41:40.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:40 smithi040 bash[13988]: audit 2024-02-22T18:41:40.603316+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:40.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:40 smithi111 bash[14162]: audit 2024-02-22T18:41:39.601022+0000 mon.a (mon.0) 460 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:41:40.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:40 smithi111 bash[14162]: cluster 2024-02-22T18:41:39.601206+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-22T18:41:40.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:40 smithi111 bash[14162]: audit 2024-02-22T18:41:39.602325+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:40.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:40 smithi111 bash[14162]: audit 2024-02-22T18:41:39.610538+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:40.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:40 smithi111 bash[14162]: cluster 2024-02-22T18:41:40.602918+0000 mon.a (mon.0) 464 : cluster [INF] osd.5 [v2:172.21.15.111:6808/3520287861,v1:172.21.15.111:6809/3520287861] boot 2024-02-22T18:41:40.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:40 smithi111 bash[14162]: cluster 2024-02-22T18:41:40.603017+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-22T18:41:40.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:40 smithi111 bash[14162]: audit 2024-02-22T18:41:40.603316+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:41:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:41 smithi111 bash[14162]: cluster 2024-02-22T18:41:39.231829+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:41:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:41 smithi111 bash[14162]: cluster 2024-02-22T18:41:39.231894+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:41:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:41 smithi111 bash[14162]: cluster 2024-02-22T18:41:40.576458+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:41 smithi111 bash[14162]: audit 2024-02-22T18:41:41.107026+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:41:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:41 smithi111 bash[14162]: audit 2024-02-22T18:41:41.110677+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:41:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:41 smithi111 bash[14162]: audit 2024-02-22T18:41:41.112644+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:41 smithi111 bash[14162]: audit 2024-02-22T18:41:41.114814+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[13988]: cluster 2024-02-22T18:41:39.231829+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:41:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[13988]: cluster 2024-02-22T18:41:39.231894+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:41:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[13988]: cluster 2024-02-22T18:41:40.576458+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[13988]: audit 2024-02-22T18:41:41.107026+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:41:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[13988]: audit 2024-02-22T18:41:41.110677+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:41:41.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[13988]: audit 2024-02-22T18:41:41.112644+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:41.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[13988]: audit 2024-02-22T18:41:41.114814+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[17964]: cluster 2024-02-22T18:41:39.231829+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:41:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[17964]: cluster 2024-02-22T18:41:39.231894+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:41:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[17964]: cluster 2024-02-22T18:41:40.576458+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T18:41:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[17964]: audit 2024-02-22T18:41:41.107026+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:41:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[17964]: audit 2024-02-22T18:41:41.110677+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:41:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[17964]: audit 2024-02-22T18:41:41.112644+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:41 smithi040 bash[17964]: audit 2024-02-22T18:41:41.114814+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:42.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:42 smithi040 bash[13988]: audit 2024-02-22T18:41:41.104964+0000 mgr.y (mgr.14138) 168 : audit [DBG] from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:41:42.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:42 smithi040 bash[13988]: cephadm 2024-02-22T18:41:41.110056+0000 mgr.y (mgr.14138) 169 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:41:42.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:42 smithi040 bash[13988]: cluster 2024-02-22T18:41:41.624297+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-22T18:41:42.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:42 smithi040 bash[17964]: audit 2024-02-22T18:41:41.104964+0000 mgr.y (mgr.14138) 168 : audit [DBG] from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:41:42.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:42 smithi040 bash[17964]: cephadm 2024-02-22T18:41:41.110056+0000 mgr.y (mgr.14138) 169 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:41:42.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:42 smithi040 bash[17964]: cluster 2024-02-22T18:41:41.624297+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-22T18:41:42.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:42 smithi111 bash[14162]: audit 2024-02-22T18:41:41.104964+0000 mgr.y (mgr.14138) 168 : audit [DBG] from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:41:42.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:42 smithi111 bash[14162]: cephadm 2024-02-22T18:41:41.110056+0000 mgr.y (mgr.14138) 169 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:41:42.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:42 smithi111 bash[14162]: cluster 2024-02-22T18:41:41.624297+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-22T18:41:43.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:43 smithi040 bash[13988]: cluster 2024-02-22T18:41:42.577024+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v147: 1 pgs: 1 peering; 0 B data, 1.7 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:43.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:43 smithi040 bash[13988]: audit 2024-02-22T18:41:42.730593+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:41:43.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:43 smithi040 bash[13988]: audit 2024-02-22T18:41:42.733324+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:41:43.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:43 smithi040 bash[17964]: cluster 2024-02-22T18:41:42.577024+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v147: 1 pgs: 1 peering; 0 B data, 1.7 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:43.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:43 smithi040 bash[17964]: audit 2024-02-22T18:41:42.730593+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:41:43.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:43 smithi040 bash[17964]: audit 2024-02-22T18:41:42.733324+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:41:43.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:43 smithi111 bash[14162]: cluster 2024-02-22T18:41:42.577024+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v147: 1 pgs: 1 peering; 0 B data, 1.7 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:43 smithi111 bash[14162]: audit 2024-02-22T18:41:42.730593+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:41:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:43 smithi111 bash[14162]: audit 2024-02-22T18:41:42.733324+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:41:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[17964]: audit 2024-02-22T18:41:44.524621+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.111:0/782322839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be21e3d-b62e-4f99-bfcb-13a410bd4eb1"}]: dispatch 2024-02-22T18:41:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[17964]: audit 2024-02-22T18:41:44.524747+0000 mon.a (mon.0) 474 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be21e3d-b62e-4f99-bfcb-13a410bd4eb1"}]: dispatch 2024-02-22T18:41:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[17964]: audit 2024-02-22T18:41:44.537890+0000 mon.a (mon.0) 475 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8be21e3d-b62e-4f99-bfcb-13a410bd4eb1"}]': finished 2024-02-22T18:41:44.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[17964]: cluster 2024-02-22T18:41:44.538068+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-22T18:41:44.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[17964]: audit 2024-02-22T18:41:44.538345+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:41:44.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[17964]: cluster 2024-02-22T18:41:44.577585+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[13988]: audit 2024-02-22T18:41:44.524621+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.111:0/782322839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be21e3d-b62e-4f99-bfcb-13a410bd4eb1"}]: dispatch 2024-02-22T18:41:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[13988]: audit 2024-02-22T18:41:44.524747+0000 mon.a (mon.0) 474 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be21e3d-b62e-4f99-bfcb-13a410bd4eb1"}]: dispatch 2024-02-22T18:41:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[13988]: audit 2024-02-22T18:41:44.537890+0000 mon.a (mon.0) 475 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8be21e3d-b62e-4f99-bfcb-13a410bd4eb1"}]': finished 2024-02-22T18:41:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[13988]: cluster 2024-02-22T18:41:44.538068+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-22T18:41:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[13988]: audit 2024-02-22T18:41:44.538345+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:41:44.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:44 smithi040 bash[13988]: cluster 2024-02-22T18:41:44.577585+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:44 smithi111 bash[14162]: audit 2024-02-22T18:41:44.524621+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.111:0/782322839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be21e3d-b62e-4f99-bfcb-13a410bd4eb1"}]: dispatch 2024-02-22T18:41:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:44 smithi111 bash[14162]: audit 2024-02-22T18:41:44.524747+0000 mon.a (mon.0) 474 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be21e3d-b62e-4f99-bfcb-13a410bd4eb1"}]: dispatch 2024-02-22T18:41:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:44 smithi111 bash[14162]: audit 2024-02-22T18:41:44.537890+0000 mon.a (mon.0) 475 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8be21e3d-b62e-4f99-bfcb-13a410bd4eb1"}]': finished 2024-02-22T18:41:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:44 smithi111 bash[14162]: cluster 2024-02-22T18:41:44.538068+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-22T18:41:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:44 smithi111 bash[14162]: audit 2024-02-22T18:41:44.538345+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:41:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:44 smithi111 bash[14162]: cluster 2024-02-22T18:41:44.577585+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:45.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:45 smithi040 bash[13988]: audit 2024-02-22T18:41:45.147910+0000 mon.b (mon.2) 14 : audit [DBG] from='client.? 172.21.15.111:0/1859560393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:41:45.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:45 smithi040 bash[17964]: audit 2024-02-22T18:41:45.147910+0000 mon.b (mon.2) 14 : audit [DBG] from='client.? 172.21.15.111:0/1859560393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:41:45.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:45 smithi111 bash[14162]: audit 2024-02-22T18:41:45.147910+0000 mon.b (mon.2) 14 : audit [DBG] from='client.? 172.21.15.111:0/1859560393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:41:47.713 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:47 smithi111 bash[14162]: cluster 2024-02-22T18:41:46.578131+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:47.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:47 smithi040 bash[13988]: cluster 2024-02-22T18:41:46.578131+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:47.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:47 smithi040 bash[17964]: cluster 2024-02-22T18:41:46.578131+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:48.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:48 smithi040 bash[13988]: audit 2024-02-22T18:41:47.958315+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:48.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:48 smithi040 bash[17964]: audit 2024-02-22T18:41:47.958315+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:48.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:48 smithi111 bash[14162]: audit 2024-02-22T18:41:47.958315+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:49.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:49 smithi040 bash[13988]: cluster 2024-02-22T18:41:48.578759+0000 mgr.y (mgr.14138) 173 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:49 smithi040 bash[17964]: cluster 2024-02-22T18:41:48.578759+0000 mgr.y (mgr.14138) 173 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:49.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:49 smithi111 bash[14162]: cluster 2024-02-22T18:41:48.578759+0000 mgr.y (mgr.14138) 173 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:51.867 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:51 smithi111 bash[14162]: cluster 2024-02-22T18:41:50.579467+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:51.867 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:51 smithi111 bash[14162]: audit 2024-02-22T18:41:51.532872+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-22T18:41:51.867 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:51 smithi111 bash[14162]: audit 2024-02-22T18:41:51.534879+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:51.867 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:51 smithi111 bash[14162]: audit 2024-02-22T18:41:51.537239+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-22T18:41:51.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:51 smithi040 bash[13988]: cluster 2024-02-22T18:41:50.579467+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:51.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:51 smithi040 bash[13988]: audit 2024-02-22T18:41:51.532872+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-22T18:41:51.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:51 smithi040 bash[13988]: audit 2024-02-22T18:41:51.534879+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:51.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:51 smithi040 bash[13988]: audit 2024-02-22T18:41:51.537239+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-22T18:41:51.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:51 smithi040 bash[17964]: cluster 2024-02-22T18:41:50.579467+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:51.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:51 smithi040 bash[17964]: audit 2024-02-22T18:41:51.532872+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-22T18:41:51.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:51 smithi040 bash[17964]: audit 2024-02-22T18:41:51.534879+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:41:51.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:51 smithi040 bash[17964]: audit 2024-02-22T18:41:51.537239+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-22T18:41:52.821 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:52 smithi111 bash[14162]: cephadm 2024-02-22T18:41:51.536471+0000 mgr.y (mgr.14138) 175 : cephadm [INF] Deploying daemon osd.6 on smithi111 2024-02-22T18:41:52.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:52 smithi040 bash[13988]: cephadm 2024-02-22T18:41:51.536471+0000 mgr.y (mgr.14138) 175 : cephadm [INF] Deploying daemon osd.6 on smithi111 2024-02-22T18:41:52.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:52 smithi040 bash[17964]: cephadm 2024-02-22T18:41:51.536471+0000 mgr.y (mgr.14138) 175 : cephadm [INF] Deploying daemon osd.6 on smithi111 2024-02-22T18:41:53.704 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 6 on host 'smithi111' 2024-02-22T18:41:53.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:53 smithi040 bash[13988]: cluster 2024-02-22T18:41:52.580185+0000 mgr.y (mgr.14138) 176 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:53.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:53 smithi040 bash[17964]: cluster 2024-02-22T18:41:52.580185+0000 mgr.y (mgr.14138) 176 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:53.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:53 smithi111 bash[14162]: cluster 2024-02-22T18:41:52.580185+0000 mgr.y (mgr.14138) 176 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:54.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:54 smithi040 bash[13988]: audit 2024-02-22T18:41:53.691231+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:54.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:54 smithi040 bash[13988]: audit 2024-02-22T18:41:53.696324+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:54.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:54 smithi040 bash[17964]: audit 2024-02-22T18:41:53.691231+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:54.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:54 smithi040 bash[17964]: audit 2024-02-22T18:41:53.696324+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:54.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:54 smithi111 bash[14162]: audit 2024-02-22T18:41:53.691231+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:41:54.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:54 smithi111 bash[14162]: audit 2024-02-22T18:41:53.696324+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:55.040 DEBUG:teuthology.orchestra.run.smithi111:osd.6> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.6.service 2024-02-22T18:41:55.042 INFO:tasks.cephadm:Deploying osd.7 on smithi111 with /dev/vg_nvme/lv_1... 2024-02-22T18:41:55.042 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-22T18:41:55.475 INFO:journalctl@ceph.osd.6.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:41:55.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:55 smithi040 bash[13988]: cluster 2024-02-22T18:41:54.580810+0000 mgr.y (mgr.14138) 177 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:55.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:55 smithi040 bash[13988]: audit 2024-02-22T18:41:54.912803+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:55.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:55 smithi040 bash[13988]: audit 2024-02-22T18:41:54.914524+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:55 smithi040 bash[17964]: cluster 2024-02-22T18:41:54.580810+0000 mgr.y (mgr.14138) 177 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:55 smithi040 bash[17964]: audit 2024-02-22T18:41:54.912803+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:55 smithi040 bash[17964]: audit 2024-02-22T18:41:54.914524+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:55.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[14162]: cluster 2024-02-22T18:41:54.580810+0000 mgr.y (mgr.14138) 177 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:55.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[14162]: audit 2024-02-22T18:41:54.912803+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:55.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[14162]: audit 2024-02-22T18:41:54.914524+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:41:55.964 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[19408]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-22T18:41:55.964 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[19408]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2024-02-22T18:41:55.964 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[19408]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2024-02-22T18:41:55.964 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[19408]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2024-02-22T18:41:55.964 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[19408]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-22T18:41:55.964 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[19408]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-22T18:41:55.964 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:41:55 smithi111 bash[19408]: --> ceph-volume lvm activate successful for osd ID: 6 2024-02-22T18:41:57.840 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:57 smithi111 bash[14162]: cluster 2024-02-22T18:41:56.581372+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:57.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:57 smithi040 bash[13988]: cluster 2024-02-22T18:41:56.581372+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:57.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:57 smithi040 bash[17964]: cluster 2024-02-22T18:41:56.581372+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:58.964 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:41:58 smithi111 bash[19646]: debug 2024-02-22T18:41:58.620+0000 7ff8e66c7f40 -1 Falling back to public interface 2024-02-22T18:41:58.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:58 smithi111 bash[14162]: audit 2024-02-22T18:41:57.729705+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:58.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:58 smithi111 bash[14162]: cluster 2024-02-22T18:41:58.581989+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:59.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:58 smithi040 bash[13988]: audit 2024-02-22T18:41:57.729705+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:59.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:58 smithi040 bash[13988]: cluster 2024-02-22T18:41:58.581989+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:59.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:58 smithi040 bash[17964]: audit 2024-02-22T18:41:57.729705+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:41:59.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:58 smithi040 bash[17964]: cluster 2024-02-22T18:41:58.581989+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:41:59.714 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:41:59 smithi111 bash[19646]: debug 2024-02-22T18:41:59.240+0000 7ff8e66c7f40 -1 osd.6 0 log_to_monitors {default=true} 2024-02-22T18:42:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:59 smithi040 bash[13988]: audit 2024-02-22T18:41:59.249390+0000 mon.a (mon.0) 487 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T18:42:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:41:59 smithi040 bash[13988]: audit 2024-02-22T18:41:59.249488+0000 mon.b (mon.2) 15 : audit [INF] from='osd.6 [v2:172.21.15.111:6816/718630314,v1:172.21.15.111:6817/718630314]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T18:42:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:59 smithi040 bash[17964]: audit 2024-02-22T18:41:59.249390+0000 mon.a (mon.0) 487 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T18:42:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:41:59 smithi040 bash[17964]: audit 2024-02-22T18:41:59.249488+0000 mon.b (mon.2) 15 : audit [INF] from='osd.6 [v2:172.21.15.111:6816/718630314,v1:172.21.15.111:6817/718630314]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T18:42:00.213 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:59 smithi111 bash[14162]: audit 2024-02-22T18:41:59.249390+0000 mon.a (mon.0) 487 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T18:42:00.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:41:59 smithi111 bash[14162]: audit 2024-02-22T18:41:59.249488+0000 mon.b (mon.2) 15 : audit [INF] from='osd.6 [v2:172.21.15.111:6816/718630314,v1:172.21.15.111:6817/718630314]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T18:42:00.505 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-22T18:42:00.505 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-22T18:42:00.505 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-02-22T18:42:00.505 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-02-22T18:42:00.505 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0181401 s, 578 MB/s 2024-02-22T18:42:00.505 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-02-22T18:42:00.964 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 18:42:00 smithi111 bash[19646]: debug 2024-02-22T18:42:00.760+0000 7ff8cf19d700 -1 osd.6 0 waiting for initial osdmap 2024-02-22T18:42:00.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:00 smithi111 bash[14162]: audit 2024-02-22T18:41:59.749473+0000 mon.a (mon.0) 488 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-22T18:42:00.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:00 smithi111 bash[14162]: cluster 2024-02-22T18:41:59.749611+0000 mon.a (mon.0) 489 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2024-02-22T18:42:00.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:00 smithi111 bash[14162]: audit 2024-02-22T18:41:59.749902+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:00.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:00 smithi111 bash[14162]: audit 2024-02-22T18:41:59.751537+0000 mon.a (mon.0) 491 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:00.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:00 smithi111 bash[14162]: audit 2024-02-22T18:41:59.751877+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.15.111:6816/718630314,v1:172.21.15.111:6817/718630314]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:00.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:00 smithi111 bash[14162]: cluster 2024-02-22T18:42:00.582549+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:42:01.141 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_1 2024-02-22T18:42:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[13988]: audit 2024-02-22T18:41:59.749473+0000 mon.a (mon.0) 488 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-22T18:42:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[13988]: cluster 2024-02-22T18:41:59.749611+0000 mon.a (mon.0) 489 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2024-02-22T18:42:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[13988]: audit 2024-02-22T18:41:59.749902+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[13988]: audit 2024-02-22T18:41:59.751537+0000 mon.a (mon.0) 491 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:01.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[13988]: audit 2024-02-22T18:41:59.751877+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.15.111:6816/718630314,v1:172.21.15.111:6817/718630314]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:01.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[13988]: cluster 2024-02-22T18:42:00.582549+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:42:01.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[17964]: audit 2024-02-22T18:41:59.749473+0000 mon.a (mon.0) 488 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-22T18:42:01.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[17964]: cluster 2024-02-22T18:41:59.749611+0000 mon.a (mon.0) 489 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2024-02-22T18:42:01.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[17964]: audit 2024-02-22T18:41:59.749902+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:01.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[17964]: audit 2024-02-22T18:41:59.751537+0000 mon.a (mon.0) 491 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:01.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[17964]: audit 2024-02-22T18:41:59.751877+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.15.111:6816/718630314,v1:172.21.15.111:6817/718630314]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:01.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:00 smithi040 bash[17964]: cluster 2024-02-22T18:42:00.582549+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T18:42:02.080 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:01 smithi111 bash[14162]: audit 2024-02-22T18:42:00.753555+0000 mon.a (mon.0) 492 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:42:02.080 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:01 smithi111 bash[14162]: cluster 2024-02-22T18:42:00.753794+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-02-22T18:42:02.080 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:01 smithi111 bash[14162]: audit 2024-02-22T18:42:00.754851+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:02.080 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:01 smithi111 bash[14162]: audit 2024-02-22T18:42:00.762451+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:02.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:01 smithi040 bash[13988]: audit 2024-02-22T18:42:00.753555+0000 mon.a (mon.0) 492 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:42:02.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:01 smithi040 bash[13988]: cluster 2024-02-22T18:42:00.753794+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-02-22T18:42:02.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:01 smithi040 bash[13988]: audit 2024-02-22T18:42:00.754851+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:02.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:01 smithi040 bash[13988]: audit 2024-02-22T18:42:00.762451+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:02.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:01 smithi040 bash[17964]: audit 2024-02-22T18:42:00.753555+0000 mon.a (mon.0) 492 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:42:02.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:01 smithi040 bash[17964]: cluster 2024-02-22T18:42:00.753794+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-02-22T18:42:02.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:01 smithi040 bash[17964]: audit 2024-02-22T18:42:00.754851+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:02.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:01 smithi040 bash[17964]: audit 2024-02-22T18:42:00.762451+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:03.069 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:02 smithi111 bash[14162]: cluster 2024-02-22T18:42:00.264214+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:42:03.069 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:02 smithi111 bash[14162]: cluster 2024-02-22T18:42:00.264294+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:42:03.069 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:02 smithi111 bash[14162]: cluster 2024-02-22T18:42:01.759973+0000 mon.a (mon.0) 496 : cluster [INF] osd.6 [v2:172.21.15.111:6816/718630314,v1:172.21.15.111:6817/718630314] boot 2024-02-22T18:42:03.069 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:02 smithi111 bash[14162]: cluster 2024-02-22T18:42:01.760122+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2024-02-22T18:42:03.069 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:02 smithi111 bash[14162]: audit 2024-02-22T18:42:01.760416+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:03.069 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:02 smithi111 bash[14162]: cluster 2024-02-22T18:42:02.583126+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:03.069 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:02 smithi111 bash[14162]: audit 2024-02-22T18:42:02.690194+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:03.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[13988]: cluster 2024-02-22T18:42:00.264214+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:42:03.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[13988]: cluster 2024-02-22T18:42:00.264294+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[13988]: cluster 2024-02-22T18:42:01.759973+0000 mon.a (mon.0) 496 : cluster [INF] osd.6 [v2:172.21.15.111:6816/718630314,v1:172.21.15.111:6817/718630314] boot 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[13988]: cluster 2024-02-22T18:42:01.760122+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[13988]: audit 2024-02-22T18:42:01.760416+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[13988]: cluster 2024-02-22T18:42:02.583126+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[13988]: audit 2024-02-22T18:42:02.690194+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[17964]: cluster 2024-02-22T18:42:00.264214+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[17964]: cluster 2024-02-22T18:42:00.264294+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[17964]: cluster 2024-02-22T18:42:01.759973+0000 mon.a (mon.0) 496 : cluster [INF] osd.6 [v2:172.21.15.111:6816/718630314,v1:172.21.15.111:6817/718630314] boot 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[17964]: cluster 2024-02-22T18:42:01.760122+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[17964]: audit 2024-02-22T18:42:01.760416+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:42:03.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[17964]: cluster 2024-02-22T18:42:02.583126+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:03.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:02 smithi040 bash[17964]: audit 2024-02-22T18:42:02.690194+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:03.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:03 smithi111 bash[14162]: cluster 2024-02-22T18:42:02.771187+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-22T18:42:03.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:03 smithi111 bash[14162]: audit 2024-02-22T18:42:03.006440+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:03.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:03 smithi111 bash[14162]: cephadm 2024-02-22T18:42:03.007795+0000 mgr.y (mgr.14138) 182 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:42:03.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:03 smithi111 bash[14162]: audit 2024-02-22T18:42:03.364204+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:03.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:03 smithi111 bash[14162]: audit 2024-02-22T18:42:03.374791+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:04.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[13988]: cluster 2024-02-22T18:42:02.771187+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-22T18:42:04.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[13988]: audit 2024-02-22T18:42:03.006440+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:04.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[13988]: cephadm 2024-02-22T18:42:03.007795+0000 mgr.y (mgr.14138) 182 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:42:04.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[13988]: audit 2024-02-22T18:42:03.364204+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:04.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[13988]: audit 2024-02-22T18:42:03.374791+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:04.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[17964]: cluster 2024-02-22T18:42:02.771187+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-22T18:42:04.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[17964]: audit 2024-02-22T18:42:03.006440+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:04.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[17964]: cephadm 2024-02-22T18:42:03.007795+0000 mgr.y (mgr.14138) 182 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:42:04.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[17964]: audit 2024-02-22T18:42:03.364204+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:04.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:03 smithi040 bash[17964]: audit 2024-02-22T18:42:03.374791+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[13988]: cluster 2024-02-22T18:42:04.583692+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[13988]: audit 2024-02-22T18:42:04.689563+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:42:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[13988]: audit 2024-02-22T18:42:04.693034+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:42:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[13988]: audit 2024-02-22T18:42:04.694927+0000 mon.a (mon.0) 506 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:42:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[13988]: audit 2024-02-22T18:42:04.697064+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:42:05.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[17964]: cluster 2024-02-22T18:42:04.583692+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:05.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[17964]: audit 2024-02-22T18:42:04.689563+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:42:05.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[17964]: audit 2024-02-22T18:42:04.693034+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:42:05.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[17964]: audit 2024-02-22T18:42:04.694927+0000 mon.a (mon.0) 506 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:42:05.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:04 smithi040 bash[17964]: audit 2024-02-22T18:42:04.697064+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:42:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:04 smithi111 bash[14162]: cluster 2024-02-22T18:42:04.583692+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:04 smithi111 bash[14162]: audit 2024-02-22T18:42:04.689563+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T18:42:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:04 smithi111 bash[14162]: audit 2024-02-22T18:42:04.693034+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T18:42:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:04 smithi111 bash[14162]: audit 2024-02-22T18:42:04.694927+0000 mon.a (mon.0) 506 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:42:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:04 smithi111 bash[14162]: audit 2024-02-22T18:42:04.697064+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:42:06.102 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:05 smithi111 bash[14162]: audit 2024-02-22T18:42:04.687481+0000 mgr.y (mgr.14138) 184 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:06.102 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:05 smithi111 bash[14162]: cephadm 2024-02-22T18:42:04.692500+0000 mgr.y (mgr.14138) 185 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:42:06.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:05 smithi040 bash[13988]: audit 2024-02-22T18:42:04.687481+0000 mgr.y (mgr.14138) 184 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:06.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:05 smithi040 bash[13988]: cephadm 2024-02-22T18:42:04.692500+0000 mgr.y (mgr.14138) 185 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:42:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:05 smithi040 bash[17964]: audit 2024-02-22T18:42:04.687481+0000 mgr.y (mgr.14138) 184 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:05 smithi040 bash[17964]: cephadm 2024-02-22T18:42:04.692500+0000 mgr.y (mgr.14138) 185 : cephadm [INF] Applying drive group None on host smithi111... 2024-02-22T18:42:07.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:07 smithi040 bash[13988]: cluster 2024-02-22T18:42:06.584178+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:07.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:07 smithi040 bash[17964]: cluster 2024-02-22T18:42:06.584178+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:07.963 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:07 smithi111 bash[14162]: cluster 2024-02-22T18:42:06.584178+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:08.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[13988]: audit 2024-02-22T18:42:08.083286+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.111:0/1106986134' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18f1582d-f05f-4d9f-a7c6-adc4131c86f4"}]: dispatch 2024-02-22T18:42:08.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[13988]: audit 2024-02-22T18:42:08.083330+0000 mon.a (mon.0) 508 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18f1582d-f05f-4d9f-a7c6-adc4131c86f4"}]: dispatch 2024-02-22T18:42:08.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[13988]: audit 2024-02-22T18:42:08.091757+0000 mon.a (mon.0) 509 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18f1582d-f05f-4d9f-a7c6-adc4131c86f4"}]': finished 2024-02-22T18:42:08.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[13988]: cluster 2024-02-22T18:42:08.091913+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2024-02-22T18:42:08.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[13988]: audit 2024-02-22T18:42:08.092225+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:08.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[17964]: audit 2024-02-22T18:42:08.083286+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.111:0/1106986134' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18f1582d-f05f-4d9f-a7c6-adc4131c86f4"}]: dispatch 2024-02-22T18:42:08.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[17964]: audit 2024-02-22T18:42:08.083330+0000 mon.a (mon.0) 508 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18f1582d-f05f-4d9f-a7c6-adc4131c86f4"}]: dispatch 2024-02-22T18:42:08.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[17964]: audit 2024-02-22T18:42:08.091757+0000 mon.a (mon.0) 509 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18f1582d-f05f-4d9f-a7c6-adc4131c86f4"}]': finished 2024-02-22T18:42:08.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[17964]: cluster 2024-02-22T18:42:08.091913+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2024-02-22T18:42:08.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:08 smithi040 bash[17964]: audit 2024-02-22T18:42:08.092225+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:08.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:08 smithi111 bash[14162]: audit 2024-02-22T18:42:08.083286+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.111:0/1106986134' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18f1582d-f05f-4d9f-a7c6-adc4131c86f4"}]: dispatch 2024-02-22T18:42:08.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:08 smithi111 bash[14162]: audit 2024-02-22T18:42:08.083330+0000 mon.a (mon.0) 508 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18f1582d-f05f-4d9f-a7c6-adc4131c86f4"}]: dispatch 2024-02-22T18:42:08.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:08 smithi111 bash[14162]: audit 2024-02-22T18:42:08.091757+0000 mon.a (mon.0) 509 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18f1582d-f05f-4d9f-a7c6-adc4131c86f4"}]': finished 2024-02-22T18:42:08.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:08 smithi111 bash[14162]: cluster 2024-02-22T18:42:08.091913+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2024-02-22T18:42:08.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:08 smithi111 bash[14162]: audit 2024-02-22T18:42:08.092225+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:09.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:09 smithi040 bash[13988]: cluster 2024-02-22T18:42:08.584709+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:09.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:09 smithi040 bash[13988]: audit 2024-02-22T18:42:08.675793+0000 mon.b (mon.2) 18 : audit [DBG] from='client.? 172.21.15.111:0/497324732' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:42:09.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:09 smithi040 bash[17964]: cluster 2024-02-22T18:42:08.584709+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:09.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:09 smithi040 bash[17964]: audit 2024-02-22T18:42:08.675793+0000 mon.b (mon.2) 18 : audit [DBG] from='client.? 172.21.15.111:0/497324732' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:42:09.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:09 smithi111 bash[14162]: cluster 2024-02-22T18:42:08.584709+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:09.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:09 smithi111 bash[14162]: audit 2024-02-22T18:42:08.675793+0000 mon.b (mon.2) 18 : audit [DBG] from='client.? 172.21.15.111:0/497324732' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T18:42:11.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:11 smithi040 bash[13988]: cluster 2024-02-22T18:42:10.585365+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:11.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:11 smithi040 bash[13988]: audit 2024-02-22T18:42:11.520323+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:42:11.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:11 smithi040 bash[17964]: cluster 2024-02-22T18:42:10.585365+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:11.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:11 smithi040 bash[17964]: audit 2024-02-22T18:42:11.520323+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:42:11.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:11 smithi111 bash[14162]: cluster 2024-02-22T18:42:10.585365+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:11.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:11 smithi111 bash[14162]: audit 2024-02-22T18:42:11.520323+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:42:13.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:13 smithi111 bash[14162]: cluster 2024-02-22T18:42:12.586013+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:13.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:13 smithi040 bash[13988]: cluster 2024-02-22T18:42:12.586013+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:13.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:13 smithi040 bash[17964]: cluster 2024-02-22T18:42:12.586013+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:15.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:15 smithi040 bash[13988]: cluster 2024-02-22T18:42:14.586603+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:15.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:15 smithi040 bash[13988]: audit 2024-02-22T18:42:15.237980+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-22T18:42:15.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:15 smithi040 bash[13988]: audit 2024-02-22T18:42:15.239864+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:42:15.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:15 smithi040 bash[13988]: audit 2024-02-22T18:42:15.242117+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-22T18:42:15.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:15 smithi040 bash[17964]: cluster 2024-02-22T18:42:14.586603+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:15.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:15 smithi040 bash[17964]: audit 2024-02-22T18:42:15.237980+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-22T18:42:15.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:15 smithi040 bash[17964]: audit 2024-02-22T18:42:15.239864+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:42:15.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:15 smithi040 bash[17964]: audit 2024-02-22T18:42:15.242117+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-22T18:42:15.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:15 smithi111 bash[14162]: cluster 2024-02-22T18:42:14.586603+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:15.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:15 smithi111 bash[14162]: audit 2024-02-22T18:42:15.237980+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-22T18:42:15.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:15 smithi111 bash[14162]: audit 2024-02-22T18:42:15.239864+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:42:15.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:15 smithi111 bash[14162]: audit 2024-02-22T18:42:15.242117+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-22T18:42:16.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:16 smithi040 bash[13988]: cephadm 2024-02-22T18:42:15.241423+0000 mgr.y (mgr.14138) 191 : cephadm [INF] Deploying daemon osd.7 on smithi111 2024-02-22T18:42:16.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:16 smithi040 bash[17964]: cephadm 2024-02-22T18:42:15.241423+0000 mgr.y (mgr.14138) 191 : cephadm [INF] Deploying daemon osd.7 on smithi111 2024-02-22T18:42:16.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:16 smithi111 bash[14162]: cephadm 2024-02-22T18:42:15.241423+0000 mgr.y (mgr.14138) 191 : cephadm [INF] Deploying daemon osd.7 on smithi111 2024-02-22T18:42:17.544 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 7 on host 'smithi111' 2024-02-22T18:42:17.884 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:17 smithi111 bash[14162]: cluster 2024-02-22T18:42:16.587198+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:17.885 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:17 smithi111 bash[14162]: audit 2024-02-22T18:42:17.531804+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:17.885 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:17 smithi111 bash[14162]: audit 2024-02-22T18:42:17.537344+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:17 smithi040 bash[13988]: cluster 2024-02-22T18:42:16.587198+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:17 smithi040 bash[13988]: audit 2024-02-22T18:42:17.531804+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:17.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:17 smithi040 bash[13988]: audit 2024-02-22T18:42:17.537344+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:17 smithi040 bash[17964]: cluster 2024-02-22T18:42:16.587198+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:17 smithi040 bash[17964]: audit 2024-02-22T18:42:17.531804+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:17 smithi040 bash[17964]: audit 2024-02-22T18:42:17.537344+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:19.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:18 smithi040 bash[13988]: audit 2024-02-22T18:42:17.737878+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:19.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:18 smithi040 bash[13988]: audit 2024-02-22T18:42:18.466330+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:19.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:18 smithi040 bash[13988]: audit 2024-02-22T18:42:18.468350+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:42:19.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:18 smithi040 bash[13988]: cluster 2024-02-22T18:42:18.587741+0000 mgr.y (mgr.14138) 193 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:19.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:18 smithi040 bash[17964]: audit 2024-02-22T18:42:17.737878+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:19.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:18 smithi040 bash[17964]: audit 2024-02-22T18:42:18.466330+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:19.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:18 smithi040 bash[17964]: audit 2024-02-22T18:42:18.468350+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:42:19.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:18 smithi040 bash[17964]: cluster 2024-02-22T18:42:18.587741+0000 mgr.y (mgr.14138) 193 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:19.283 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:18 smithi111 bash[14162]: audit 2024-02-22T18:42:17.737878+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:19.284 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:18 smithi111 bash[14162]: audit 2024-02-22T18:42:18.466330+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:19.284 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:18 smithi111 bash[14162]: audit 2024-02-22T18:42:18.468350+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T18:42:19.284 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:18 smithi111 bash[14162]: cluster 2024-02-22T18:42:18.587741+0000 mgr.y (mgr.14138) 193 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:19.372 DEBUG:teuthology.orchestra.run.smithi111:osd.7> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.7.service 2024-02-22T18:42:19.374 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-22T18:42:19.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd stat -f json 2024-02-22T18:42:20.009 INFO:journalctl@ceph.osd.7.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:42:20.464 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:20 smithi111 bash[21041]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-22T18:42:20.464 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:20 smithi111 bash[21041]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2024-02-22T18:42:20.464 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:20 smithi111 bash[21041]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2024-02-22T18:42:20.464 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:20 smithi111 bash[21041]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2024-02-22T18:42:20.464 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:20 smithi111 bash[21041]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-22T18:42:20.465 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:20 smithi111 bash[21041]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-22T18:42:20.465 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:20 smithi111 bash[21041]: --> ceph-volume lvm activate successful for osd ID: 7 2024-02-22T18:42:20.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:20 smithi040 bash[13988]: cluster 2024-02-22T18:42:20.588226+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:20.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:20 smithi040 bash[17964]: cluster 2024-02-22T18:42:20.588226+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:20 smithi111 bash[14162]: cluster 2024-02-22T18:42:20.588226+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:22.246 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:42:22.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:22 smithi040 bash[13988]: audit 2024-02-22T18:42:22.243010+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.40:0/596644927' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T18:42:22.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:22 smithi040 bash[17964]: audit 2024-02-22T18:42:22.243010+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.40:0/596644927' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T18:42:22.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:22 smithi111 bash[14162]: audit 2024-02-22T18:42:22.243010+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.40:0/596644927' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T18:42:22.914 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1708627321,"num_in_osds":7,"osd_in_since":1708627321,"num_remapped_pgs":0} 2024-02-22T18:42:23.464 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:23 smithi111 bash[21373]: debug 2024-02-22T18:42:23.016+0000 7f6e74c64f40 -1 Falling back to public interface 2024-02-22T18:42:23.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd stat -f json 2024-02-22T18:42:23.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:23 smithi040 bash[13988]: cluster 2024-02-22T18:42:22.588901+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:23.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:23 smithi040 bash[17964]: cluster 2024-02-22T18:42:22.588901+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:23.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:23 smithi111 bash[14162]: cluster 2024-02-22T18:42:22.588901+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:23.964 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:23 smithi111 bash[21373]: debug 2024-02-22T18:42:23.656+0000 7f6e74c64f40 -1 osd.7 0 log_to_monitors {default=true} 2024-02-22T18:42:24.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:24 smithi040 bash[13988]: audit 2024-02-22T18:42:23.663181+0000 mon.a (mon.0) 521 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T18:42:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:24 smithi040 bash[13988]: audit 2024-02-22T18:42:23.663339+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 [v2:172.21.15.111:6824/949159104,v1:172.21.15.111:6825/949159104]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T18:42:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:24 smithi040 bash[13988]: audit 2024-02-22T18:42:24.321367+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:24.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:24 smithi040 bash[17964]: audit 2024-02-22T18:42:23.663181+0000 mon.a (mon.0) 521 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T18:42:24.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:24 smithi040 bash[17964]: audit 2024-02-22T18:42:23.663339+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 [v2:172.21.15.111:6824/949159104,v1:172.21.15.111:6825/949159104]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T18:42:24.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:24 smithi040 bash[17964]: audit 2024-02-22T18:42:24.321367+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:24 smithi111 bash[14162]: audit 2024-02-22T18:42:23.663181+0000 mon.a (mon.0) 521 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T18:42:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:24 smithi111 bash[14162]: audit 2024-02-22T18:42:23.663339+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 [v2:172.21.15.111:6824/949159104,v1:172.21.15.111:6825/949159104]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T18:42:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:24 smithi111 bash[14162]: audit 2024-02-22T18:42:24.321367+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[13988]: cluster 2024-02-22T18:42:24.589485+0000 mgr.y (mgr.14138) 196 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[13988]: audit 2024-02-22T18:42:24.611342+0000 mon.a (mon.0) 523 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-22T18:42:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[13988]: cluster 2024-02-22T18:42:24.611645+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2024-02-22T18:42:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[13988]: audit 2024-02-22T18:42:24.611886+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[13988]: audit 2024-02-22T18:42:24.613335+0000 mon.a (mon.0) 526 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[13988]: audit 2024-02-22T18:42:24.613685+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.15.111:6824/949159104,v1:172.21.15.111:6825/949159104]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[13988]: audit 2024-02-22T18:42:24.634262+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[13988]: audit 2024-02-22T18:42:24.643201+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[13988]: audit 2024-02-22T18:42:25.035010+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[17964]: cluster 2024-02-22T18:42:24.589485+0000 mgr.y (mgr.14138) 196 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[17964]: audit 2024-02-22T18:42:24.611342+0000 mon.a (mon.0) 523 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-22T18:42:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[17964]: cluster 2024-02-22T18:42:24.611645+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2024-02-22T18:42:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[17964]: audit 2024-02-22T18:42:24.611886+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[17964]: audit 2024-02-22T18:42:24.613335+0000 mon.a (mon.0) 526 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[17964]: audit 2024-02-22T18:42:24.613685+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.15.111:6824/949159104,v1:172.21.15.111:6825/949159104]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[17964]: audit 2024-02-22T18:42:24.634262+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[17964]: audit 2024-02-22T18:42:24.643201+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:25 smithi040 bash[17964]: audit 2024-02-22T18:42:25.035010+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:25.964 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[21373]: debug 2024-02-22T18:42:25.624+0000 7f6e5d73a700 -1 osd.7 0 waiting for initial osdmap 2024-02-22T18:42:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[14162]: cluster 2024-02-22T18:42:24.589485+0000 mgr.y (mgr.14138) 196 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[14162]: audit 2024-02-22T18:42:24.611342+0000 mon.a (mon.0) 523 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-22T18:42:25.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[14162]: cluster 2024-02-22T18:42:24.611645+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2024-02-22T18:42:25.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[14162]: audit 2024-02-22T18:42:24.611886+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:25.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[14162]: audit 2024-02-22T18:42:24.613335+0000 mon.a (mon.0) 526 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:25.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[14162]: audit 2024-02-22T18:42:24.613685+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.15.111:6824/949159104,v1:172.21.15.111:6825/949159104]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-22T18:42:25.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[14162]: audit 2024-02-22T18:42:24.634262+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:25.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[14162]: audit 2024-02-22T18:42:24.643201+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:25.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:25 smithi111 bash[14162]: audit 2024-02-22T18:42:25.035010+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:26.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[17964]: cephadm 2024-02-22T18:42:24.646588+0000 mgr.y (mgr.14138) 197 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:42:26.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[17964]: audit 2024-02-22T18:42:25.612647+0000 mon.a (mon.0) 530 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:42:26.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[17964]: cluster 2024-02-22T18:42:25.612988+0000 mon.a (mon.0) 531 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-02-22T18:42:26.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[17964]: audit 2024-02-22T18:42:25.614132+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:26.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[17964]: audit 2024-02-22T18:42:25.624442+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:26.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[13988]: cephadm 2024-02-22T18:42:24.646588+0000 mgr.y (mgr.14138) 197 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:42:26.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[13988]: audit 2024-02-22T18:42:25.612647+0000 mon.a (mon.0) 530 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:42:26.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[13988]: cluster 2024-02-22T18:42:25.612988+0000 mon.a (mon.0) 531 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-02-22T18:42:26.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[13988]: audit 2024-02-22T18:42:25.614132+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:26.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:26 smithi040 bash[13988]: audit 2024-02-22T18:42:25.624442+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:26.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:26 smithi111 bash[14162]: cephadm 2024-02-22T18:42:24.646588+0000 mgr.y (mgr.14138) 197 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:42:26.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:26 smithi111 bash[14162]: audit 2024-02-22T18:42:25.612647+0000 mon.a (mon.0) 530 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-22T18:42:26.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:26 smithi111 bash[14162]: cluster 2024-02-22T18:42:25.612988+0000 mon.a (mon.0) 531 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-02-22T18:42:26.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:26 smithi111 bash[14162]: audit 2024-02-22T18:42:25.614132+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:26.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:26 smithi111 bash[14162]: audit 2024-02-22T18:42:25.624442+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:26.973 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:42:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1708627346,"num_in_osds":8,"osd_in_since":1708627346,"num_remapped_pgs":0} 2024-02-22T18:42:27.650 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi111 2024-02-22T18:42:27.650 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd pool create iscsi 3 3 replicated 2024-02-22T18:42:27.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[13988]: cluster 2024-02-22T18:42:24.679153+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[13988]: cluster 2024-02-22T18:42:24.679265+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[13988]: cluster 2024-02-22T18:42:26.590119+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[13988]: audit 2024-02-22T18:42:26.622253+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[13988]: cluster 2024-02-22T18:42:26.636818+0000 mon.a (mon.0) 535 : cluster [INF] osd.7 [v2:172.21.15.111:6824/949159104,v1:172.21.15.111:6825/949159104] boot 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[13988]: cluster 2024-02-22T18:42:26.636894+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[13988]: audit 2024-02-22T18:42:26.637120+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[13988]: audit 2024-02-22T18:42:26.970838+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.40:0/2923083675' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[17964]: cluster 2024-02-22T18:42:24.679153+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[17964]: cluster 2024-02-22T18:42:24.679265+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[17964]: cluster 2024-02-22T18:42:26.590119+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:27.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[17964]: audit 2024-02-22T18:42:26.622253+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:27.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[17964]: cluster 2024-02-22T18:42:26.636818+0000 mon.a (mon.0) 535 : cluster [INF] osd.7 [v2:172.21.15.111:6824/949159104,v1:172.21.15.111:6825/949159104] boot 2024-02-22T18:42:27.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[17964]: cluster 2024-02-22T18:42:26.636894+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2024-02-22T18:42:27.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[17964]: audit 2024-02-22T18:42:26.637120+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:27.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:27 smithi040 bash[17964]: audit 2024-02-22T18:42:26.970838+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.40:0/2923083675' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T18:42:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:27 smithi111 bash[14162]: cluster 2024-02-22T18:42:24.679153+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T18:42:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:27 smithi111 bash[14162]: cluster 2024-02-22T18:42:24.679265+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T18:42:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:27 smithi111 bash[14162]: cluster 2024-02-22T18:42:26.590119+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T18:42:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:27 smithi111 bash[14162]: audit 2024-02-22T18:42:26.622253+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:27 smithi111 bash[14162]: cluster 2024-02-22T18:42:26.636818+0000 mon.a (mon.0) 535 : cluster [INF] osd.7 [v2:172.21.15.111:6824/949159104,v1:172.21.15.111:6825/949159104] boot 2024-02-22T18:42:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:27 smithi111 bash[14162]: cluster 2024-02-22T18:42:26.636894+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2024-02-22T18:42:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:27 smithi111 bash[14162]: audit 2024-02-22T18:42:26.637120+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:42:27.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:27 smithi111 bash[14162]: audit 2024-02-22T18:42:26.970838+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.40:0/2923083675' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T18:42:28.882 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:28 smithi111 bash[14162]: cluster 2024-02-22T18:42:27.639617+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2024-02-22T18:42:28.882 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:28 smithi111 bash[14162]: cluster 2024-02-22T18:42:28.590722+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v180: 1 pgs: 1 peering; 0 B data, 3.2 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:28.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:28 smithi040 bash[13988]: cluster 2024-02-22T18:42:27.639617+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2024-02-22T18:42:28.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:28 smithi040 bash[13988]: cluster 2024-02-22T18:42:28.590722+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v180: 1 pgs: 1 peering; 0 B data, 3.2 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:28.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:28 smithi040 bash[17964]: cluster 2024-02-22T18:42:27.639617+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2024-02-22T18:42:28.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:28 smithi040 bash[17964]: cluster 2024-02-22T18:42:28.590722+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v180: 1 pgs: 1 peering; 0 B data, 3.2 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:30.895 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'iscsi' created 2024-02-22T18:42:31.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:30 smithi040 bash[13988]: audit 2024-02-22T18:42:30.378249+0000 mon.a (mon.0) 539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-22T18:42:31.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:30 smithi040 bash[13988]: audit 2024-02-22T18:42:30.378440+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.111:0/2978856735' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-22T18:42:31.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:30 smithi040 bash[13988]: cluster 2024-02-22T18:42:30.591265+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v181: 1 pgs: 1 peering; 0 B data, 3.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:31.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:30 smithi040 bash[17964]: audit 2024-02-22T18:42:30.378249+0000 mon.a (mon.0) 539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-22T18:42:31.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:30 smithi040 bash[17964]: audit 2024-02-22T18:42:30.378440+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.111:0/2978856735' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-22T18:42:31.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:30 smithi040 bash[17964]: cluster 2024-02-22T18:42:30.591265+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v181: 1 pgs: 1 peering; 0 B data, 3.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:31.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:30 smithi111 bash[14162]: audit 2024-02-22T18:42:30.378249+0000 mon.a (mon.0) 539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-22T18:42:31.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:30 smithi111 bash[14162]: audit 2024-02-22T18:42:30.378440+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.111:0/2978856735' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-22T18:42:31.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:30 smithi111 bash[14162]: cluster 2024-02-22T18:42:30.591265+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v181: 1 pgs: 1 peering; 0 B data, 3.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:31.601 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd pool application enable iscsi rbd 2024-02-22T18:42:32.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:31 smithi040 bash[13988]: audit 2024-02-22T18:42:30.885868+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-22T18:42:32.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:31 smithi040 bash[13988]: cluster 2024-02-22T18:42:30.886165+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-22T18:42:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:31 smithi040 bash[17964]: audit 2024-02-22T18:42:30.885868+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-22T18:42:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:31 smithi040 bash[17964]: cluster 2024-02-22T18:42:30.886165+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-22T18:42:32.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:31 smithi111 bash[14162]: audit 2024-02-22T18:42:30.885868+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-22T18:42:32.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:31 smithi111 bash[14162]: cluster 2024-02-22T18:42:30.886165+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-22T18:42:33.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:32 smithi040 bash[13988]: cluster 2024-02-22T18:42:31.910393+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-22T18:42:33.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:32 smithi040 bash[13988]: cluster 2024-02-22T18:42:32.591867+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v184: 4 pgs: 3 unknown, 1 peering; 0 B data, 3.4 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:33.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:32 smithi040 bash[17964]: cluster 2024-02-22T18:42:31.910393+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-22T18:42:33.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:32 smithi040 bash[17964]: cluster 2024-02-22T18:42:32.591867+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v184: 4 pgs: 3 unknown, 1 peering; 0 B data, 3.4 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:33.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:32 smithi111 bash[14162]: cluster 2024-02-22T18:42:31.910393+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-22T18:42:33.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:33 smithi111 bash[14162]: cluster 2024-02-22T18:42:32.591867+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v184: 4 pgs: 3 unknown, 1 peering; 0 B data, 3.4 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:34.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:33 smithi040 bash[13988]: cluster 2024-02-22T18:42:32.919524+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-22T18:42:34.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:33 smithi040 bash[17964]: cluster 2024-02-22T18:42:32.919524+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-22T18:42:34.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:33 smithi111 bash[14162]: cluster 2024-02-22T18:42:32.919524+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-22T18:42:34.940 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rbd' on pool 'iscsi' 2024-02-22T18:42:35.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:34 smithi040 bash[13988]: audit 2024-02-22T18:42:34.412831+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-22T18:42:35.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:34 smithi040 bash[13988]: audit 2024-02-22T18:42:34.413010+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.111:0/2996706187' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-22T18:42:35.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:34 smithi040 bash[13988]: cluster 2024-02-22T18:42:34.592469+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v186: 4 pgs: 2 active+clean, 2 unknown; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:35.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:34 smithi040 bash[17964]: audit 2024-02-22T18:42:34.412831+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-22T18:42:35.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:34 smithi040 bash[17964]: audit 2024-02-22T18:42:34.413010+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.111:0/2996706187' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-22T18:42:35.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:34 smithi040 bash[17964]: cluster 2024-02-22T18:42:34.592469+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v186: 4 pgs: 2 active+clean, 2 unknown; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:35.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:34 smithi111 bash[14162]: audit 2024-02-22T18:42:34.412831+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-22T18:42:35.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:34 smithi111 bash[14162]: audit 2024-02-22T18:42:34.413010+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.111:0/2996706187' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-22T18:42:35.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:34 smithi111 bash[14162]: cluster 2024-02-22T18:42:34.592469+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v186: 4 pgs: 2 active+clean, 2 unknown; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:35.599 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch apply iscsi iscsi user password --placement '1;smithi111=iscsi.a' 2024-02-22T18:42:36.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:35 smithi111 bash[14162]: audit 2024-02-22T18:42:34.930872+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-22T18:42:36.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:35 smithi111 bash[14162]: cluster 2024-02-22T18:42:34.931028+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-22T18:42:36.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:35 smithi040 bash[13988]: audit 2024-02-22T18:42:34.930872+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-22T18:42:36.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:35 smithi040 bash[13988]: cluster 2024-02-22T18:42:34.931028+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-22T18:42:36.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:35 smithi040 bash[17964]: audit 2024-02-22T18:42:34.930872+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-22T18:42:36.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:35 smithi040 bash[17964]: cluster 2024-02-22T18:42:34.931028+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-22T18:42:37.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:37 smithi111 bash[14162]: cluster 2024-02-22T18:42:36.593194+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v188: 4 pgs: 4 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:37.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:37 smithi040 bash[13988]: cluster 2024-02-22T18:42:36.593194+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v188: 4 pgs: 4 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:37.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:37 smithi040 bash[17964]: cluster 2024-02-22T18:42:36.593194+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v188: 4 pgs: 4 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:38.387 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled iscsi.iscsi update... 2024-02-22T18:42:38.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: audit 2024-02-22T18:42:37.746059+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:38.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: audit 2024-02-22T18:42:38.374716+0000 mgr.y (mgr.14138) 204 : audit [DBG] from='client.34349 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi111=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:38.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: cephadm 2024-02-22T18:42:38.376339+0000 mgr.y (mgr.14138) 205 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi111=iscsi.a;count:1 2024-02-22T18:42:38.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: audit 2024-02-22T18:42:38.382872+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:38.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: audit 2024-02-22T18:42:38.392448+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:38.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: cephadm 2024-02-22T18:42:38.395220+0000 mgr.y (mgr.14138) 206 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-22T18:42:38.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: cephadm 2024-02-22T18:42:38.406288+0000 mgr.y (mgr.14138) 207 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi111=iscsi.a;count:1 2024-02-22T18:42:38.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: audit 2024-02-22T18:42:38.411461+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:38.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: audit 2024-02-22T18:42:38.412756+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blacklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:42:38.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: audit 2024-02-22T18:42:38.418262+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blacklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2024-02-22T18:42:38.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: audit 2024-02-22T18:42:38.433100+0000 mon.a (mon.0) 553 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:42:38.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: cephadm 2024-02-22T18:42:38.434325+0000 mgr.y (mgr.14138) 208 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi111 2024-02-22T18:42:38.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: audit 2024-02-22T18:42:38.435186+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2024-02-22T18:42:38.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:38 smithi111 bash[14162]: cluster 2024-02-22T18:42:38.593877+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v189: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:39.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: audit 2024-02-22T18:42:37.746059+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:39.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: audit 2024-02-22T18:42:38.374716+0000 mgr.y (mgr.14138) 204 : audit [DBG] from='client.34349 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi111=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: cephadm 2024-02-22T18:42:38.376339+0000 mgr.y (mgr.14138) 205 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi111=iscsi.a;count:1 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: audit 2024-02-22T18:42:38.382872+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: audit 2024-02-22T18:42:38.392448+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: cephadm 2024-02-22T18:42:38.395220+0000 mgr.y (mgr.14138) 206 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: cephadm 2024-02-22T18:42:38.406288+0000 mgr.y (mgr.14138) 207 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi111=iscsi.a;count:1 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: audit 2024-02-22T18:42:38.411461+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: audit 2024-02-22T18:42:38.412756+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blacklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: audit 2024-02-22T18:42:38.418262+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blacklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: audit 2024-02-22T18:42:38.433100+0000 mon.a (mon.0) 553 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: cephadm 2024-02-22T18:42:38.434325+0000 mgr.y (mgr.14138) 208 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi111 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: audit 2024-02-22T18:42:38.435186+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2024-02-22T18:42:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[13988]: cluster 2024-02-22T18:42:38.593877+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v189: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: audit 2024-02-22T18:42:37.746059+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: audit 2024-02-22T18:42:38.374716+0000 mgr.y (mgr.14138) 204 : audit [DBG] from='client.34349 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi111=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: cephadm 2024-02-22T18:42:38.376339+0000 mgr.y (mgr.14138) 205 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi111=iscsi.a;count:1 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: audit 2024-02-22T18:42:38.382872+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: audit 2024-02-22T18:42:38.392448+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: cephadm 2024-02-22T18:42:38.395220+0000 mgr.y (mgr.14138) 206 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: cephadm 2024-02-22T18:42:38.406288+0000 mgr.y (mgr.14138) 207 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi111=iscsi.a;count:1 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: audit 2024-02-22T18:42:38.411461+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: audit 2024-02-22T18:42:38.412756+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blacklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: audit 2024-02-22T18:42:38.418262+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blacklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: audit 2024-02-22T18:42:38.433100+0000 mon.a (mon.0) 553 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: cephadm 2024-02-22T18:42:38.434325+0000 mgr.y (mgr.14138) 208 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi111 2024-02-22T18:42:39.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: audit 2024-02-22T18:42:38.435186+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2024-02-22T18:42:39.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:38 smithi040 bash[17964]: cluster 2024-02-22T18:42:38.593877+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v189: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:39.400 DEBUG:teuthology.orchestra.run.smithi111:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service 2024-02-22T18:42:39.403 INFO:tasks.cephadm:Adding prometheus.a on smithi111 2024-02-22T18:42:39.403 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch apply prometheus '1;smithi111=a' 2024-02-22T18:42:39.816 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:42:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:41 smithi111 bash[14162]: cluster 2024-02-22T18:42:40.431681+0000 mon.a (mon.0) 555 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-02-22T18:42:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:41 smithi111 bash[14162]: cluster 2024-02-22T18:42:40.594481+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v190: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:41 smithi040 bash[13988]: cluster 2024-02-22T18:42:40.431681+0000 mon.a (mon.0) 555 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-02-22T18:42:41.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:41 smithi040 bash[13988]: cluster 2024-02-22T18:42:40.594481+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v190: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:41 smithi040 bash[17964]: cluster 2024-02-22T18:42:40.431681+0000 mon.a (mon.0) 555 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-02-22T18:42:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:41 smithi040 bash[17964]: cluster 2024-02-22T18:42:40.594481+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v190: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:43.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[13988]: audit 2024-02-22T18:42:41.852142+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:43.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[13988]: audit 2024-02-22T18:42:41.855049+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:43.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[13988]: cluster 2024-02-22T18:42:42.595196+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v191: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:43.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[13988]: audit 2024-02-22T18:42:42.733532+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:42:43.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[13988]: audit 2024-02-22T18:42:42.736399+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:42:43.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[17964]: audit 2024-02-22T18:42:41.852142+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:43.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[17964]: audit 2024-02-22T18:42:41.855049+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:43.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[17964]: cluster 2024-02-22T18:42:42.595196+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v191: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:43.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[17964]: audit 2024-02-22T18:42:42.733532+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:42:43.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:42 smithi040 bash[17964]: audit 2024-02-22T18:42:42.736399+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:42:43.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:42 smithi111 bash[14162]: audit 2024-02-22T18:42:41.852142+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:43.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:42 smithi111 bash[14162]: audit 2024-02-22T18:42:41.855049+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:42:43.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:42 smithi111 bash[14162]: cluster 2024-02-22T18:42:42.595196+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v191: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:43.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:42 smithi111 bash[14162]: audit 2024-02-22T18:42:42.733532+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:42:43.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:42 smithi111 bash[14162]: audit 2024-02-22T18:42:42.736399+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:42:43.587 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:42:43 smithi111 bash[22429]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T18:42:44.148 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled prometheus update... 2024-02-22T18:42:44.861 DEBUG:teuthology.orchestra.run.smithi111:prometheus.a> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@prometheus.a.service 2024-02-22T18:42:44.863 INFO:tasks.cephadm:Adding node-exporter.a on smithi040 2024-02-22T18:42:44.863 INFO:tasks.cephadm:Adding node-exporter.b on smithi111 2024-02-22T18:42:44.863 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch apply node-exporter '2;smithi040=a;smithi111=b' 2024-02-22T18:42:45.313 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:42:45.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[13988]: audit 2024-02-22T18:42:44.136491+0000 mgr.y (mgr.14138) 212 : audit [DBG] from='client.34361 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:45.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[13988]: cephadm 2024-02-22T18:42:44.138082+0000 mgr.y (mgr.14138) 213 : cephadm [INF] Saving service prometheus spec with placement smithi111=a;count:1 2024-02-22T18:42:45.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[13988]: audit 2024-02-22T18:42:44.144232+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:45.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[13988]: audit 2024-02-22T18:42:44.215874+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:45.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[13988]: audit 2024-02-22T18:42:44.221697+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:45.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[13988]: cephadm 2024-02-22T18:42:44.236173+0000 mgr.y (mgr.14138) 214 : cephadm [INF] Deploying daemon prometheus.a on smithi111 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[13988]: audit 2024-02-22T18:42:44.481266+0000 mon.b (mon.2) 23 : audit [DBG] from='client.? 172.21.15.111:0/3942616036' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[13988]: cluster 2024-02-22T18:42:44.595951+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v192: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[17964]: audit 2024-02-22T18:42:44.136491+0000 mgr.y (mgr.14138) 212 : audit [DBG] from='client.34361 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[17964]: cephadm 2024-02-22T18:42:44.138082+0000 mgr.y (mgr.14138) 213 : cephadm [INF] Saving service prometheus spec with placement smithi111=a;count:1 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[17964]: audit 2024-02-22T18:42:44.144232+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[17964]: audit 2024-02-22T18:42:44.215874+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[17964]: audit 2024-02-22T18:42:44.221697+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[17964]: cephadm 2024-02-22T18:42:44.236173+0000 mgr.y (mgr.14138) 214 : cephadm [INF] Deploying daemon prometheus.a on smithi111 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[17964]: audit 2024-02-22T18:42:44.481266+0000 mon.b (mon.2) 23 : audit [DBG] from='client.? 172.21.15.111:0/3942616036' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:42:45.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:45 smithi040 bash[17964]: cluster 2024-02-22T18:42:44.595951+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v192: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:45.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:45 smithi111 bash[14162]: audit 2024-02-22T18:42:44.136491+0000 mgr.y (mgr.14138) 212 : audit [DBG] from='client.34361 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:45.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:45 smithi111 bash[14162]: cephadm 2024-02-22T18:42:44.138082+0000 mgr.y (mgr.14138) 213 : cephadm [INF] Saving service prometheus spec with placement smithi111=a;count:1 2024-02-22T18:42:45.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:45 smithi111 bash[14162]: audit 2024-02-22T18:42:44.144232+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:45.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:45 smithi111 bash[14162]: audit 2024-02-22T18:42:44.215874+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:45.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:45 smithi111 bash[14162]: audit 2024-02-22T18:42:44.221697+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:45.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:45 smithi111 bash[14162]: cephadm 2024-02-22T18:42:44.236173+0000 mgr.y (mgr.14138) 214 : cephadm [INF] Deploying daemon prometheus.a on smithi111 2024-02-22T18:42:45.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:45 smithi111 bash[14162]: audit 2024-02-22T18:42:44.481266+0000 mon.b (mon.2) 23 : audit [DBG] from='client.? 172.21.15.111:0/3942616036' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:42:45.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:45 smithi111 bash[14162]: cluster 2024-02-22T18:42:44.595951+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v192: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:47.709 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled node-exporter update... 2024-02-22T18:42:47.879 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:47 smithi111 bash[14162]: cluster 2024-02-22T18:42:46.596631+0000 mgr.y (mgr.14138) 216 : cluster [DBG] pgmap v193: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:47.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:47 smithi040 bash[13988]: cluster 2024-02-22T18:42:46.596631+0000 mgr.y (mgr.14138) 216 : cluster [DBG] pgmap v193: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:47.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:47 smithi040 bash[17964]: cluster 2024-02-22T18:42:46.596631+0000 mgr.y (mgr.14138) 216 : cluster [DBG] pgmap v193: 4 pgs: 4 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:48.375 DEBUG:teuthology.orchestra.run.smithi040:node-exporter.a> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@node-exporter.a.service 2024-02-22T18:42:48.377 DEBUG:teuthology.orchestra.run.smithi111:node-exporter.b> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@node-exporter.b.service 2024-02-22T18:42:48.379 INFO:tasks.cephadm:Adding alertmanager.a on smithi040 2024-02-22T18:42:48.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch apply alertmanager '1;smithi040=a' 2024-02-22T18:42:48.558 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:42:48.675 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:42:48.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:48 smithi111 bash[14162]: audit 2024-02-22T18:42:47.697101+0000 mgr.y (mgr.14138) 217 : audit [DBG] from='client.34385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi040=a;smithi111=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:48.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:48 smithi111 bash[14162]: cephadm 2024-02-22T18:42:47.698697+0000 mgr.y (mgr.14138) 218 : cephadm [INF] Saving service node-exporter spec with placement smithi040=a;smithi111=b;count:2 2024-02-22T18:42:48.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:48 smithi111 bash[14162]: audit 2024-02-22T18:42:47.704804+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:48.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:48 smithi111 bash[14162]: cluster 2024-02-22T18:42:48.597409+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v194: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:49.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:48 smithi040 bash[13988]: audit 2024-02-22T18:42:47.697101+0000 mgr.y (mgr.14138) 217 : audit [DBG] from='client.34385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi040=a;smithi111=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:49.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:48 smithi040 bash[13988]: cephadm 2024-02-22T18:42:47.698697+0000 mgr.y (mgr.14138) 218 : cephadm [INF] Saving service node-exporter spec with placement smithi040=a;smithi111=b;count:2 2024-02-22T18:42:49.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:48 smithi040 bash[13988]: audit 2024-02-22T18:42:47.704804+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:49.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:48 smithi040 bash[13988]: cluster 2024-02-22T18:42:48.597409+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v194: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:49.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:48 smithi040 bash[17964]: audit 2024-02-22T18:42:47.697101+0000 mgr.y (mgr.14138) 217 : audit [DBG] from='client.34385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi040=a;smithi111=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:49.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:48 smithi040 bash[17964]: cephadm 2024-02-22T18:42:47.698697+0000 mgr.y (mgr.14138) 218 : cephadm [INF] Saving service node-exporter spec with placement smithi040=a;smithi111=b;count:2 2024-02-22T18:42:49.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:48 smithi040 bash[17964]: audit 2024-02-22T18:42:47.704804+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:49.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:48 smithi040 bash[17964]: cluster 2024-02-22T18:42:48.597409+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v194: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:50.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:50 smithi111 bash[14162]: cluster 2024-02-22T18:42:50.598050+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v195: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:51.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:50 smithi040 bash[13988]: cluster 2024-02-22T18:42:50.598050+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v195: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:51.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:50 smithi040 bash[17964]: cluster 2024-02-22T18:42:50.598050+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v195: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:52.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:52 smithi111 bash[14162]: cluster 2024-02-22T18:42:52.598662+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v196: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:53.005 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled alertmanager update... 2024-02-22T18:42:53.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:52 smithi040 bash[13988]: cluster 2024-02-22T18:42:52.598662+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v196: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:53.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:52 smithi040 bash[17964]: cluster 2024-02-22T18:42:52.598662+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v196: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:42:54.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:54 smithi040 bash[13988]: audit 2024-02-22T18:42:52.993357+0000 mgr.y (mgr.14138) 222 : audit [DBG] from='client.34391 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi040=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:54.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:54 smithi040 bash[13988]: cephadm 2024-02-22T18:42:52.994857+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Saving service alertmanager spec with placement smithi040=a;count:1 2024-02-22T18:42:54.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:54 smithi040 bash[13988]: audit 2024-02-22T18:42:53.001044+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:54.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:54 smithi040 bash[17964]: audit 2024-02-22T18:42:52.993357+0000 mgr.y (mgr.14138) 222 : audit [DBG] from='client.34391 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi040=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:54.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:54 smithi040 bash[17964]: cephadm 2024-02-22T18:42:52.994857+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Saving service alertmanager spec with placement smithi040=a;count:1 2024-02-22T18:42:54.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:54 smithi040 bash[17964]: audit 2024-02-22T18:42:53.001044+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:54.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:54 smithi111 bash[14162]: audit 2024-02-22T18:42:52.993357+0000 mgr.y (mgr.14138) 222 : audit [DBG] from='client.34391 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi040=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:42:54.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:54 smithi111 bash[14162]: cephadm 2024-02-22T18:42:52.994857+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Saving service alertmanager spec with placement smithi040=a;count:1 2024-02-22T18:42:54.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:54 smithi111 bash[14162]: audit 2024-02-22T18:42:53.001044+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:42:54.735 DEBUG:teuthology.orchestra.run.smithi040:alertmanager.a> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@alertmanager.a.service 2024-02-22T18:42:54.738 INFO:tasks.cephadm:Adding grafana.a on smithi111 2024-02-22T18:42:54.738 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph orch apply grafana '1;smithi111=a' 2024-02-22T18:42:54.778 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:42:55.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:55 smithi111 bash[14162]: cluster 2024-02-22T18:42:54.599275+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v197: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:42:55.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:55 smithi040 bash[13988]: cluster 2024-02-22T18:42:54.599275+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v197: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:42:55.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:55 smithi040 bash[17964]: cluster 2024-02-22T18:42:54.599275+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v197: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:42:57.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:57 smithi040 bash[13988]: cluster 2024-02-22T18:42:56.599868+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v198: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-22T18:42:57.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:57 smithi040 bash[17964]: cluster 2024-02-22T18:42:56.599868+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v198: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-22T18:42:57.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:57 smithi111 bash[14162]: cluster 2024-02-22T18:42:56.599868+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v198: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-22T18:42:58.951 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:42:58 smithi111 bash[14162]: cluster 2024-02-22T18:42:58.600543+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v199: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:42:59.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:42:58 smithi040 bash[13988]: cluster 2024-02-22T18:42:58.600543+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v199: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:42:59.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:42:58 smithi040 bash[17964]: cluster 2024-02-22T18:42:58.600543+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v199: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:42:59.355 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled grafana update... 2024-02-22T18:43:00.650 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:00 smithi111 bash[14162]: audit 2024-02-22T18:42:59.343453+0000 mgr.y (mgr.14138) 227 : audit [DBG] from='client.34397 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:43:00.650 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:00 smithi111 bash[14162]: cephadm 2024-02-22T18:42:59.344998+0000 mgr.y (mgr.14138) 228 : cephadm [INF] Saving service grafana spec with placement smithi111=a;count:1 2024-02-22T18:43:00.650 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:00 smithi111 bash[14162]: audit 2024-02-22T18:42:59.351386+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:00 smithi040 bash[13988]: audit 2024-02-22T18:42:59.343453+0000 mgr.y (mgr.14138) 227 : audit [DBG] from='client.34397 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:43:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:00 smithi040 bash[13988]: cephadm 2024-02-22T18:42:59.344998+0000 mgr.y (mgr.14138) 228 : cephadm [INF] Saving service grafana spec with placement smithi111=a;count:1 2024-02-22T18:43:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:00 smithi040 bash[13988]: audit 2024-02-22T18:42:59.351386+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:00.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:00 smithi040 bash[17964]: audit 2024-02-22T18:42:59.343453+0000 mgr.y (mgr.14138) 227 : audit [DBG] from='client.34397 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:43:00.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:00 smithi040 bash[17964]: cephadm 2024-02-22T18:42:59.344998+0000 mgr.y (mgr.14138) 228 : cephadm [INF] Saving service grafana spec with placement smithi111=a;count:1 2024-02-22T18:43:00.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:00 smithi040 bash[17964]: audit 2024-02-22T18:42:59.351386+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:00.922 DEBUG:teuthology.orchestra.run.smithi111:grafana.a> sudo journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@grafana.a.service 2024-02-22T18:43:00.925 INFO:tasks.cephadm:Setting up client nodes... 2024-02-22T18:43:00.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-22T18:43:01.343 INFO:journalctl@ceph.grafana.a.smithi111.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-22T18:43:01.633 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:01 smithi111 bash[14162]: cluster 2024-02-22T18:43:00.601164+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v200: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:01 smithi040 bash[13988]: cluster 2024-02-22T18:43:00.601164+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v200: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:01.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:01 smithi040 bash[17964]: cluster 2024-02-22T18:43:00.601164+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v200: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:02.684 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:02 smithi111 bash[14162]: cluster 2024-02-22T18:43:02.601825+0000 mgr.y (mgr.14138) 230 : cluster [DBG] pgmap v201: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:03.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:02 smithi040 bash[13988]: cluster 2024-02-22T18:43:02.601825+0000 mgr.y (mgr.14138) 230 : cluster [DBG] pgmap v201: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:03.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:02 smithi040 bash[17964]: cluster 2024-02-22T18:43:02.601825+0000 mgr.y (mgr.14138) 230 : cluster [DBG] pgmap v201: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:03.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:03 smithi111 bash[14162]: audit 2024-02-22T18:43:02.822892+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:03.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:03 smithi111 bash[14162]: audit 2024-02-22T18:43:02.825679+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:43:03.964 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:43:03 smithi111 bash[23664]: level=info ts=2024-02-22T18:43:03.758Z caller=main.go:646 msg="Server is ready to receive web requests." 2024-02-22T18:43:04.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:03 smithi040 bash[13988]: audit 2024-02-22T18:43:02.822892+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:04.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:03 smithi040 bash[13988]: audit 2024-02-22T18:43:02.825679+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:43:04.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:03 smithi040 bash[17964]: audit 2024-02-22T18:43:02.822892+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:04.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:03 smithi040 bash[17964]: audit 2024-02-22T18:43:02.825679+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:43:04.179 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-02-22T18:43:04.179 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC4lddlroEVChAAP1xuCRHi3pkgJg3khlKpZA== 2024-02-22T18:43:04.887 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-22T18:43:04.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-22T18:43:04.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-22T18:43:04.903 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-22T18:43:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:05 smithi111 bash[14162]: audit 2024-02-22T18:43:04.008793+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:05.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:05 smithi111 bash[14162]: cephadm 2024-02-22T18:43:04.010189+0000 mgr.y (mgr.14138) 231 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:43:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:05 smithi111 bash[14162]: audit 2024-02-22T18:43:04.168148+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.40:0/2806836890' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:05 smithi111 bash[14162]: audit 2024-02-22T18:43:04.168832+0000 mon.a (mon.0) 569 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:05 smithi111 bash[14162]: audit 2024-02-22T18:43:04.173666+0000 mon.a (mon.0) 570 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T18:43:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:05 smithi111 bash[14162]: audit 2024-02-22T18:43:04.364230+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:05 smithi111 bash[14162]: cephadm 2024-02-22T18:43:04.367820+0000 mgr.y (mgr.14138) 232 : cephadm [INF] Deploying daemon node-exporter.a on smithi040 2024-02-22T18:43:05.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:05 smithi111 bash[14162]: cluster 2024-02-22T18:43:04.602299+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v202: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:05.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:05 smithi040 systemd[1]: Started Ceph node-exporter.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:43:05.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[26607]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2024-02-22T18:43:05.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[13988]: audit 2024-02-22T18:43:04.008793+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:05.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[13988]: cephadm 2024-02-22T18:43:04.010189+0000 mgr.y (mgr.14138) 231 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:43:05.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[13988]: audit 2024-02-22T18:43:04.168148+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.40:0/2806836890' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:05.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[13988]: audit 2024-02-22T18:43:04.168832+0000 mon.a (mon.0) 569 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:05.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[13988]: audit 2024-02-22T18:43:04.173666+0000 mon.a (mon.0) 570 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T18:43:05.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[13988]: audit 2024-02-22T18:43:04.364230+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:05.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[13988]: cephadm 2024-02-22T18:43:04.367820+0000 mgr.y (mgr.14138) 232 : cephadm [INF] Deploying daemon node-exporter.a on smithi040 2024-02-22T18:43:05.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[13988]: cluster 2024-02-22T18:43:04.602299+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v202: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:05.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[17964]: audit 2024-02-22T18:43:04.008793+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:05.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[17964]: cephadm 2024-02-22T18:43:04.010189+0000 mgr.y (mgr.14138) 231 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:43:05.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[17964]: audit 2024-02-22T18:43:04.168148+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.40:0/2806836890' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:05.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[17964]: audit 2024-02-22T18:43:04.168832+0000 mon.a (mon.0) 569 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:05.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[17964]: audit 2024-02-22T18:43:04.173666+0000 mon.a (mon.0) 570 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T18:43:05.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[17964]: audit 2024-02-22T18:43:04.364230+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:05.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[17964]: cephadm 2024-02-22T18:43:04.367820+0000 mgr.y (mgr.14138) 232 : cephadm [INF] Deploying daemon node-exporter.a on smithi040 2024-02-22T18:43:05.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:05 smithi040 bash[17964]: cluster 2024-02-22T18:43:04.602299+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v202: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:06.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:06 smithi111 bash[14162]: audit 2024-02-22T18:43:05.133279+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:06.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:06 smithi111 bash[14162]: cephadm 2024-02-22T18:43:05.134324+0000 mgr.y (mgr.14138) 234 : cephadm [INF] Deploying daemon node-exporter.b on smithi111 2024-02-22T18:43:06.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:06 smithi111 bash[14162]: audit 2024-02-22T18:43:05.923529+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:06.215 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:05 smithi111 systemd[1]: Started Ceph node-exporter.b for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:43:06.215 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:05 smithi111 bash[23996]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2024-02-22T18:43:06.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:06 smithi040 bash[13988]: audit 2024-02-22T18:43:05.133279+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:06.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:06 smithi040 bash[13988]: cephadm 2024-02-22T18:43:05.134324+0000 mgr.y (mgr.14138) 234 : cephadm [INF] Deploying daemon node-exporter.b on smithi111 2024-02-22T18:43:06.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:06 smithi040 bash[13988]: audit 2024-02-22T18:43:05.923529+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:06.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:06 smithi040 bash[17964]: audit 2024-02-22T18:43:05.133279+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:06.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:06 smithi040 bash[17964]: cephadm 2024-02-22T18:43:05.134324+0000 mgr.y (mgr.14138) 234 : cephadm [INF] Deploying daemon node-exporter.b on smithi111 2024-02-22T18:43:06.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:06 smithi040 bash[17964]: audit 2024-02-22T18:43:05.923529+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:07.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:07 smithi040 bash[13988]: cephadm 2024-02-22T18:43:05.935333+0000 mgr.y (mgr.14138) 235 : cephadm [INF] Deploying daemon alertmanager.a on smithi040 2024-02-22T18:43:07.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:07 smithi040 bash[13988]: cluster 2024-02-22T18:43:06.602842+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v203: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:07.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:07 smithi040 bash[17964]: cephadm 2024-02-22T18:43:05.935333+0000 mgr.y (mgr.14138) 235 : cephadm [INF] Deploying daemon alertmanager.a on smithi040 2024-02-22T18:43:07.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:07 smithi040 bash[17964]: cluster 2024-02-22T18:43:06.602842+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v203: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:07.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:07 smithi111 bash[14162]: cephadm 2024-02-22T18:43:05.935333+0000 mgr.y (mgr.14138) 235 : cephadm [INF] Deploying daemon alertmanager.a on smithi040 2024-02-22T18:43:07.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:07 smithi111 bash[14162]: cluster 2024-02-22T18:43:06.602842+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v203: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:08.077 INFO:teuthology.orchestra.run.smithi111.stdout:[client.1] 2024-02-22T18:43:08.077 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQC8lddlz7H+AxAAXXv8AXShuwsR1jI9k/CwtA== 2024-02-22T18:43:08.790 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-22T18:43:08.790 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-22T18:43:08.790 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-22T18:43:08.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd dump --format=json 2024-02-22T18:43:08.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:08 smithi040 bash[26607]: v0.18.1: Pulling from prom/node-exporter 2024-02-22T18:43:08.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:08 smithi040 bash[13988]: audit 2024-02-22T18:43:08.066657+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:08.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:08 smithi040 bash[13988]: audit 2024-02-22T18:43:08.066934+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.111:0/108355713' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:08.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:08 smithi040 bash[13988]: audit 2024-02-22T18:43:08.073636+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T18:43:08.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:08 smithi040 bash[17964]: audit 2024-02-22T18:43:08.066657+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:08.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:08 smithi040 bash[17964]: audit 2024-02-22T18:43:08.066934+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.111:0/108355713' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:08.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:08 smithi040 bash[17964]: audit 2024-02-22T18:43:08.073636+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T18:43:08.943 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:08.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:08 smithi111 bash[14162]: audit 2024-02-22T18:43:08.066657+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:08.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:08 smithi111 bash[14162]: audit 2024-02-22T18:43:08.066934+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.111:0/108355713' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T18:43:08.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:08 smithi111 bash[14162]: audit 2024-02-22T18:43:08.073636+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T18:43:09.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 49a2d53aa1af: Pulling fs layer 2024-02-22T18:43:09.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 3589a6efd9ce: Pulling fs layer 2024-02-22T18:43:09.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 190160031744: Pulling fs layer 2024-02-22T18:43:09.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 49a2d53aa1af: Waiting 2024-02-22T18:43:09.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 3589a6efd9ce: Waiting 2024-02-22T18:43:09.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 190160031744: Waiting 2024-02-22T18:43:09.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:09 smithi111 bash[14162]: cluster 2024-02-22T18:43:08.603494+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v204: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:09.714 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:09 smithi111 bash[23996]: v0.18.1: Pulling from prom/node-exporter 2024-02-22T18:43:09.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[13988]: cluster 2024-02-22T18:43:08.603494+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v204: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:09.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[17964]: cluster 2024-02-22T18:43:08.603494+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v204: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:09.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 3589a6efd9ce: Verifying Checksum 2024-02-22T18:43:09.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 3589a6efd9ce: Download complete 2024-02-22T18:43:09.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 49a2d53aa1af: Verifying Checksum 2024-02-22T18:43:09.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 49a2d53aa1af: Download complete 2024-02-22T18:43:10.090 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:09 smithi111 bash[23996]: 49a2d53aa1af: Pulling fs layer 2024-02-22T18:43:10.090 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:09 smithi111 bash[23996]: 3589a6efd9ce: Pulling fs layer 2024-02-22T18:43:10.090 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:09 smithi111 bash[23996]: 190160031744: Pulling fs layer 2024-02-22T18:43:10.090 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:09 smithi111 bash[23996]: 3589a6efd9ce: Verifying Checksum 2024-02-22T18:43:10.090 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:09 smithi111 bash[23996]: 3589a6efd9ce: Download complete 2024-02-22T18:43:10.090 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:09 smithi111 bash[23996]: 49a2d53aa1af: Verifying Checksum 2024-02-22T18:43:10.090 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:09 smithi111 bash[23996]: 49a2d53aa1af: Download complete 2024-02-22T18:43:10.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 190160031744: Verifying Checksum 2024-02-22T18:43:10.429 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:09 smithi040 bash[26607]: 190160031744: Download complete 2024-02-22T18:43:10.464 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:10 smithi111 bash[23996]: 190160031744: Verifying Checksum 2024-02-22T18:43:10.464 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:10 smithi111 bash[23996]: 190160031744: Download complete 2024-02-22T18:43:10.464 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:10 smithi111 bash[23996]: 49a2d53aa1af: Pull complete 2024-02-22T18:43:10.964 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:10 smithi111 bash[23996]: 3589a6efd9ce: Pull complete 2024-02-22T18:43:11.132 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:10 smithi040 bash[26607]: 49a2d53aa1af: Pull complete 2024-02-22T18:43:11.464 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:10 smithi111 bash[23996]: 190160031744: Pull complete 2024-02-22T18:43:11.464 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:11 smithi111 bash[23996]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2024-02-22T18:43:11.464 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:11 smithi111 bash[23996]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2024-02-22T18:43:11.958 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:11 smithi040 bash[13988]: cluster 2024-02-22T18:43:10.604082+0000 mgr.y (mgr.14138) 238 : cluster [DBG] pgmap v205: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:11.959 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:11 smithi040 bash[17964]: cluster 2024-02-22T18:43:10.604082+0000 mgr.y (mgr.14138) 238 : cluster [DBG] pgmap v205: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:11.959 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:11 smithi040 bash[26607]: 3589a6efd9ce: Pull complete 2024-02-22T18:43:11.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:11 smithi111 bash[14162]: cluster 2024-02-22T18:43:10.604082+0000 mgr.y (mgr.14138) 238 : cluster [DBG] pgmap v205: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:12.715 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2024-02-22T18:43:12.715 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2024-02-22T18:43:12.715 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2024-02-22T18:43:12.715 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - arp" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - bcache" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - bonding" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - cpu" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - edac" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - entropy" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - filefd" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2024-02-22T18:43:12.716 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - netclass" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - netdev" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - netstat" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - nfs" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - pressure" source="node_exporter.go:104" 2024-02-22T18:43:12.717 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2024-02-22T18:43:12.718 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - stat" source="node_exporter.go:104" 2024-02-22T18:43:12.718 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - textfile" source="node_exporter.go:104" 2024-02-22T18:43:12.718 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - time" source="node_exporter.go:104" 2024-02-22T18:43:12.718 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - uname" source="node_exporter.go:104" 2024-02-22T18:43:12.718 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2024-02-22T18:43:12.718 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - xfs" source="node_exporter.go:104" 2024-02-22T18:43:12.718 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg=" - zfs" source="node_exporter.go:104" 2024-02-22T18:43:12.718 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 18:43:12 smithi111 bash[23996]: time="2024-02-22T18:43:12Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2024-02-22T18:43:13.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:12 smithi040 bash[26607]: 190160031744: Pull complete 2024-02-22T18:43:13.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:13 smithi040 bash[13988]: cluster 2024-02-22T18:43:12.604612+0000 mgr.y (mgr.14138) 239 : cluster [DBG] pgmap v206: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:13.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:13 smithi040 bash[17964]: cluster 2024-02-22T18:43:12.604612+0000 mgr.y (mgr.14138) 239 : cluster [DBG] pgmap v206: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:13.679 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:13 smithi040 bash[26607]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2024-02-22T18:43:13.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:13 smithi111 bash[14162]: cluster 2024-02-22T18:43:12.604612+0000 mgr.y (mgr.14138) 239 : cluster [DBG] pgmap v206: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:14.043 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:13 smithi040 bash[26607]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2024-02-22T18:43:15.673 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:15 smithi040 bash[13988]: cluster 2024-02-22T18:43:14.605342+0000 mgr.y (mgr.14138) 240 : cluster [DBG] pgmap v207: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:15.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:15 smithi040 bash[17964]: cluster 2024-02-22T18:43:14.605342+0000 mgr.y (mgr.14138) 240 : cluster [DBG] pgmap v207: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:15.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:15 smithi111 bash[14162]: cluster 2024-02-22T18:43:14.605342+0000 mgr.y (mgr.14138) 240 : cluster [DBG] pgmap v207: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:16.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:43:16.672 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"fsid":"42039b9c-d1b1-11ee-95bf-87774f69a715","created":"2024-02-22T18:37:00.494467+0000","modified":"2024-02-22T18:42:34.916751+0000","last_up_change":"2024-02-22T18:42:26.620417+0000","last_in_change":"2024-02-22T18:42:26.620417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T18:38:34.972392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"iscsi","create_time":"2024-02-22T18:42:30.826756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8a82ec4-54e0-41b7-9aee-587ee3cc94c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6803","nonce":2441240869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6805","nonce":2441240869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6809","nonce":2441240869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6807","nonce":2441240869}]},"public_addr":"172.21.15.40:6803/2441240869","cluster_addr":"172.21.15.40:6805/2441240869","heartbeat_back_addr":"172.21.15.40:6809/2441240869","heartbeat_front_addr":"172.21.15.40:6807/2441240869","state":["exists","up"]},{"osd":1,"uuid":"ad58d21e-9da6-4d9d-92e6-30140338e2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6811","nonce":2470022647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6813","nonce":2470022647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6817","nonce":2470022647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6815","nonce":2470022647}]},"public_addr":"172.21.15.40:6811/2470022647","cluster_addr":"172.21.15.40:6813/2470022647","heartbeat_back_addr":"172.21.15.40:6817/2470022647","heartbeat_front_addr":"172.21.15.40:6815/2470022647","state":["exists","up"]},{"osd":2,"uuid":"6c217ed3-b763-4e88-9c69-698c6f73d47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6819","nonce":1820825800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6821","nonce":1820825800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6825","nonce":1820825800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6823","nonce":1820825800}]},"public_addr":"172.21.15.40:6819/1820825800","cluster_addr":"172.21.15.40:6821/1820825800","heartbeat_back_addr":"172.21.15.40:6825/1820825800","heartbeat_front_addr":"172.21.15.40:6823/1820825800","state":["exists","up"]},{"osd":3,"uuid":"c2bc81e9-d620-44f8-87ab-e5936b9f42bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6827","nonce":3447321731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6829","nonce":3447321731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6833","nonce":3447321731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6831","nonce":3447321731}]},"public_addr":"172.21.15.40:6827/3447321731","cluster_addr":"172.21.15.40:6829/3447321731","heartbeat_back_addr":"172.21.15.40:6833/3447321731","heartbeat_front_addr":"172.21.15.40:6831/3447321731","state":["exists","up"]},{"osd":4,"uuid":"64699f72-f560-4205-93e5-ce6cc4ee34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6801","nonce":1993784371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6803","nonce":1993784371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6807","nonce":1993784371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6805","nonce":1993784371}]},"public_addr":"172.21.15.111:6801/1993784371","cluster_addr":"172.21.15.111:6803/1993784371","heartbeat_back_addr":"172.21.15.111:6807/1993784371","heartbeat_front_addr":"172.21.15.111:6805/1993784371","state":["exists","up"]},{"osd":5,"uuid":"f071be67-ae85-4824-ba99-0ffec0951e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6809","nonce":3520287861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6811","nonce":3520287861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6815","nonce":3520287861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6813","nonce":3520287861}]},"public_addr":"172.21.15.111:6809/3520287861","cluster_addr":"172.21.15.111:6811/3520287861","heartbeat_back_addr":"172.21.15.111:6815/3520287861","heartbeat_front_addr":"172.21.15.111:6813/3520287861","state":["exists","up"]},{"osd":6,"uuid":"8be21e3d-b62e-4f99-bfcb-13a410bd4eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6817","nonce":718630314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6819","nonce":718630314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6823","nonce":718630314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6821","nonce":718630314}]},"public_addr":"172.21.15.111:6817/718630314","cluster_addr":"172.21.15.111:6819/718630314","heartbeat_back_addr":"172.21.15.111:6823/718630314","heartbeat_front_addr":"172.21.15.111:6821/718630314","state":["exists","up"]},{"osd":7,"uuid":"18f1582d-f05f-4d9f-a7c6-adc4131c86f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6825","nonce":949159104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6827","nonce":949159104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6831","nonce":949159104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6829","nonce":949159104}]},"public_addr":"172.21.15.111:6825/949159104","cluster_addr":"172.21.15.111:6827/949159104","heartbeat_back_addr":"172.21.15.111:6831/949159104","heartbeat_front_addr":"172.21.15.111:6829/949159104","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:39:42.920423+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:40:04.961191+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:40:32.061563+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:40:55.481013+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:41:14.677546+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:41:39.231899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:42:00.264299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:42:24.679273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.40:6801/2234583781":"2024-02-23T18:37:42.054346+0000","172.21.15.40:6800/2234583781":"2024-02-23T18:37:42.054346+0000","172.21.15.40:0/3802138041":"2024-02-23T18:37:42.054346+0000","172.21.15.40:0/3335014977":"2024-02-23T18:37:23.497986+0000","172.21.15.40:0/2606668330":"2024-02-23T18:37:42.054346+0000","172.21.15.40:0/3097014655":"2024-02-23T18:37:23.497986+0000","172.21.15.40:6800/4078705069":"2024-02-23T18:37:23.497986+0000","172.21.15.40:6801/4078705069":"2024-02-23T18:37:23.497986+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - arp" source="node_exporter.go:104" 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - bcache" source="node_exporter.go:104" 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - bonding" source="node_exporter.go:104" 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - cpu" source="node_exporter.go:104" 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2024-02-22T18:43:16.680 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2024-02-22T18:43:16.681 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - edac" source="node_exporter.go:104" 2024-02-22T18:43:16.681 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - entropy" source="node_exporter.go:104" 2024-02-22T18:43:16.681 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - filefd" source="node_exporter.go:104" 2024-02-22T18:43:16.681 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2024-02-22T18:43:16.681 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2024-02-22T18:43:16.681 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2024-02-22T18:43:16.681 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2024-02-22T18:43:16.681 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2024-02-22T18:43:16.681 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - netclass" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - netdev" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - netstat" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - nfs" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - pressure" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - stat" source="node_exporter.go:104" 2024-02-22T18:43:16.682 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - textfile" source="node_exporter.go:104" 2024-02-22T18:43:16.683 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - time" source="node_exporter.go:104" 2024-02-22T18:43:16.683 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - uname" source="node_exporter.go:104" 2024-02-22T18:43:16.683 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2024-02-22T18:43:16.683 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - xfs" source="node_exporter.go:104" 2024-02-22T18:43:16.683 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg=" - zfs" source="node_exporter.go:104" 2024-02-22T18:43:16.683 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 18:43:16 smithi040 bash[26607]: time="2024-02-22T18:43:16Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2024-02-22T18:43:17.491 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-22T18:38:34.972392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'iscsi', 'create_time': '2024-02-22T18:42:30.826756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-02-22T18:43:17.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-22T18:43:17.610 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:17 smithi040 bash[13988]: cluster 2024-02-22T18:43:16.605976+0000 mgr.y (mgr.14138) 241 : cluster [DBG] pgmap v208: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:17.610 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:17 smithi040 bash[13988]: audit 2024-02-22T18:43:16.666956+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.40:0/3437877695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T18:43:17.627 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:17 smithi040 bash[17964]: cluster 2024-02-22T18:43:16.605976+0000 mgr.y (mgr.14138) 241 : cluster [DBG] pgmap v208: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:17.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:17 smithi040 bash[17964]: audit 2024-02-22T18:43:16.666956+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.40:0/3437877695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T18:43:17.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:17 smithi111 bash[14162]: cluster 2024-02-22T18:43:16.605976+0000 mgr.y (mgr.14138) 241 : cluster [DBG] pgmap v208: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:17.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:17 smithi111 bash[14162]: audit 2024-02-22T18:43:16.666956+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.40:0/3437877695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T18:43:18.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:18 smithi040 bash[13988]: cluster 2024-02-22T18:43:18.606637+0000 mgr.y (mgr.14138) 242 : cluster [DBG] pgmap v209: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:18.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:18 smithi040 bash[17964]: cluster 2024-02-22T18:43:18.606637+0000 mgr.y (mgr.14138) 242 : cluster [DBG] pgmap v209: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:18.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:18 smithi111 bash[14162]: cluster 2024-02-22T18:43:18.606637+0000 mgr.y (mgr.14138) 242 : cluster [DBG] pgmap v209: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:20.764 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:20 smithi040 bash[13988]: cluster 2024-02-22T18:43:20.607301+0000 mgr.y (mgr.14138) 243 : cluster [DBG] pgmap v210: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:20 smithi111 bash[14162]: cluster 2024-02-22T18:43:20.607301+0000 mgr.y (mgr.14138) 243 : cluster [DBG] pgmap v210: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:21.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:20 smithi040 bash[17964]: cluster 2024-02-22T18:43:20.607301+0000 mgr.y (mgr.14138) 243 : cluster [DBG] pgmap v210: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:21.870 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-02-22T18:43:22.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[13988]: audit 2024-02-22T18:43:21.714972+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:22.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[13988]: audit 2024-02-22T18:43:21.867392+0000 mon.a (mon.0) 577 : audit [DBG] from='client.? 172.21.15.40:0/476005221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T18:43:22.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[13988]: audit 2024-02-22T18:43:21.895658+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:22.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[13988]: audit 2024-02-22T18:43:21.901324+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:22.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[13988]: audit 2024-02-22T18:43:21.902250+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[13988]: audit 2024-02-22T18:43:21.902925+0000 mgr.y (mgr.14138) 244 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[13988]: audit 2024-02-22T18:43:21.909803+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[13988]: cephadm 2024-02-22T18:43:21.915954+0000 mgr.y (mgr.14138) 245 : cephadm [INF] Deploying daemon grafana.a on smithi111 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[13988]: cluster 2024-02-22T18:43:22.607982+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v211: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[17964]: audit 2024-02-22T18:43:21.714972+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[17964]: audit 2024-02-22T18:43:21.867392+0000 mon.a (mon.0) 577 : audit [DBG] from='client.? 172.21.15.40:0/476005221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[17964]: audit 2024-02-22T18:43:21.895658+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[17964]: audit 2024-02-22T18:43:21.901324+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[17964]: audit 2024-02-22T18:43:21.902250+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[17964]: audit 2024-02-22T18:43:21.902925+0000 mgr.y (mgr.14138) 244 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-22T18:43:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[17964]: audit 2024-02-22T18:43:21.909803+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:22.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[17964]: cephadm 2024-02-22T18:43:21.915954+0000 mgr.y (mgr.14138) 245 : cephadm [INF] Deploying daemon grafana.a on smithi111 2024-02-22T18:43:22.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:22 smithi040 bash[17964]: cluster 2024-02-22T18:43:22.607982+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v211: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:23.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd pool get iscsi pg_num 2024-02-22T18:43:23.157 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:23.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:22 smithi111 bash[14162]: audit 2024-02-22T18:43:21.714972+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:23.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:22 smithi111 bash[14162]: audit 2024-02-22T18:43:21.867392+0000 mon.a (mon.0) 577 : audit [DBG] from='client.? 172.21.15.40:0/476005221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T18:43:23.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:22 smithi111 bash[14162]: audit 2024-02-22T18:43:21.895658+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:23.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:22 smithi111 bash[14162]: audit 2024-02-22T18:43:21.901324+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:23.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:22 smithi111 bash[14162]: audit 2024-02-22T18:43:21.902250+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-22T18:43:23.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:22 smithi111 bash[14162]: audit 2024-02-22T18:43:21.902925+0000 mgr.y (mgr.14138) 244 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-22T18:43:23.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:22 smithi111 bash[14162]: audit 2024-02-22T18:43:21.909803+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:23.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:22 smithi111 bash[14162]: cephadm 2024-02-22T18:43:21.915954+0000 mgr.y (mgr.14138) 245 : cephadm [INF] Deploying daemon grafana.a on smithi111 2024-02-22T18:43:23.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:22 smithi111 bash[14162]: cluster 2024-02-22T18:43:22.607982+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v211: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:23.929 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:23 smithi040 bash[27270]: level=info ts=2024-02-22T18:43:23.740Z caller=main.go:497 msg=Listening address=:9093 2024-02-22T18:43:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:24 smithi040 bash[13988]: cluster 2024-02-22T18:43:24.608686+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v212: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:24.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:24 smithi040 bash[17964]: cluster 2024-02-22T18:43:24.608686+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v212: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:24 smithi111 bash[14162]: cluster 2024-02-22T18:43:24.608686+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v212: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:26.111 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 3 2024-02-22T18:43:26.140 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:25 smithi040 bash[27270]: level=info ts=2024-02-22T18:43:25.694Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000158511s 2024-02-22T18:43:26.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:26 smithi040 bash[13988]: audit 2024-02-22T18:43:26.108320+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.40:0/444851791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-22T18:43:26.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:26 smithi040 bash[17964]: audit 2024-02-22T18:43:26.108320+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.40:0/444851791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-22T18:43:26.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:26 smithi111 bash[14162]: audit 2024-02-22T18:43:26.108320+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.40:0/444851791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-22T18:43:26.758 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-22T18:43:26.758 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-22T18:43:26.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph mgr dump --format=json 2024-02-22T18:43:26.889 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:27.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:27 smithi040 bash[17964]: cluster 2024-02-22T18:43:26.609431+0000 mgr.y (mgr.14138) 248 : cluster [DBG] pgmap v213: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:27.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:27 smithi040 bash[13988]: cluster 2024-02-22T18:43:26.609431+0000 mgr.y (mgr.14138) 248 : cluster [DBG] pgmap v213: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:27 smithi111 bash[14162]: cluster 2024-02-22T18:43:26.609431+0000 mgr.y (mgr.14138) 248 : cluster [DBG] pgmap v213: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:28.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:28 smithi040 bash[17964]: cluster 2024-02-22T18:43:28.610180+0000 mgr.y (mgr.14138) 249 : cluster [DBG] pgmap v214: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:28.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:28 smithi040 bash[13988]: cluster 2024-02-22T18:43:28.610180+0000 mgr.y (mgr.14138) 249 : cluster [DBG] pgmap v214: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:28.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:28 smithi111 bash[14162]: cluster 2024-02-22T18:43:28.610180+0000 mgr.y (mgr.14138) 249 : cluster [DBG] pgmap v214: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:29.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:43:29.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:29 smithi040 bash[13988]: audit 2024-02-22T18:43:29.600618+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.40:0/1870493822' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T18:43:29.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:29 smithi040 bash[17964]: audit 2024-02-22T18:43:29.600618+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.40:0/1870493822' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T18:43:29.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:29 smithi111 bash[14162]: audit 2024-02-22T18:43:29.600618+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.40:0/1870493822' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T18:43:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":15,"active_gid":14138,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1821988057},{"type":"v1","addr":"172.21.15.40:6801","nonce":1821988057}]},"active_addr":"172.21.15.40:6801/1821988057","active_change":"2024-02-22T18:37:42.054923+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi040.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3358025793}]},{"addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":4184710204}]},{"addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":385477782}]}]}} 2024-02-22T18:43:30.274 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-22T18:43:30.274 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-22T18:43:30.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd dump --format=json 2024-02-22T18:43:30.408 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:30.701 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:30 smithi040 bash[13988]: cluster 2024-02-22T18:43:30.610816+0000 mgr.y (mgr.14138) 250 : cluster [DBG] pgmap v215: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:30.968 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:30 smithi111 bash[14162]: cluster 2024-02-22T18:43:30.610816+0000 mgr.y (mgr.14138) 250 : cluster [DBG] pgmap v215: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:31.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:30 smithi040 bash[17964]: cluster 2024-02-22T18:43:30.610816+0000 mgr.y (mgr.14138) 250 : cluster [DBG] pgmap v215: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:32.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:32 smithi111 bash[14162]: cluster 2024-02-22T18:43:32.611451+0000 mgr.y (mgr.14138) 251 : cluster [DBG] pgmap v216: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:32.972 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:32 smithi040 bash[13988]: cluster 2024-02-22T18:43:32.611451+0000 mgr.y (mgr.14138) 251 : cluster [DBG] pgmap v216: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:32.973 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:32 smithi040 bash[17964]: cluster 2024-02-22T18:43:32.611451+0000 mgr.y (mgr.14138) 251 : cluster [DBG] pgmap v216: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:33.252 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:43:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"fsid":"42039b9c-d1b1-11ee-95bf-87774f69a715","created":"2024-02-22T18:37:00.494467+0000","modified":"2024-02-22T18:42:34.916751+0000","last_up_change":"2024-02-22T18:42:26.620417+0000","last_in_change":"2024-02-22T18:42:26.620417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T18:38:34.972392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"iscsi","create_time":"2024-02-22T18:42:30.826756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8a82ec4-54e0-41b7-9aee-587ee3cc94c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6803","nonce":2441240869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6805","nonce":2441240869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6809","nonce":2441240869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6807","nonce":2441240869}]},"public_addr":"172.21.15.40:6803/2441240869","cluster_addr":"172.21.15.40:6805/2441240869","heartbeat_back_addr":"172.21.15.40:6809/2441240869","heartbeat_front_addr":"172.21.15.40:6807/2441240869","state":["exists","up"]},{"osd":1,"uuid":"ad58d21e-9da6-4d9d-92e6-30140338e2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6811","nonce":2470022647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6813","nonce":2470022647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6817","nonce":2470022647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6815","nonce":2470022647}]},"public_addr":"172.21.15.40:6811/2470022647","cluster_addr":"172.21.15.40:6813/2470022647","heartbeat_back_addr":"172.21.15.40:6817/2470022647","heartbeat_front_addr":"172.21.15.40:6815/2470022647","state":["exists","up"]},{"osd":2,"uuid":"6c217ed3-b763-4e88-9c69-698c6f73d47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6819","nonce":1820825800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6821","nonce":1820825800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6825","nonce":1820825800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6823","nonce":1820825800}]},"public_addr":"172.21.15.40:6819/1820825800","cluster_addr":"172.21.15.40:6821/1820825800","heartbeat_back_addr":"172.21.15.40:6825/1820825800","heartbeat_front_addr":"172.21.15.40:6823/1820825800","state":["exists","up"]},{"osd":3,"uuid":"c2bc81e9-d620-44f8-87ab-e5936b9f42bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6827","nonce":3447321731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6829","nonce":3447321731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6833","nonce":3447321731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6831","nonce":3447321731}]},"public_addr":"172.21.15.40:6827/3447321731","cluster_addr":"172.21.15.40:6829/3447321731","heartbeat_back_addr":"172.21.15.40:6833/3447321731","heartbeat_front_addr":"172.21.15.40:6831/3447321731","state":["exists","up"]},{"osd":4,"uuid":"64699f72-f560-4205-93e5-ce6cc4ee34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6801","nonce":1993784371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6803","nonce":1993784371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6807","nonce":1993784371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6805","nonce":1993784371}]},"public_addr":"172.21.15.111:6801/1993784371","cluster_addr":"172.21.15.111:6803/1993784371","heartbeat_back_addr":"172.21.15.111:6807/1993784371","heartbeat_front_addr":"172.21.15.111:6805/1993784371","state":["exists","up"]},{"osd":5,"uuid":"f071be67-ae85-4824-ba99-0ffec0951e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6809","nonce":3520287861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6811","nonce":3520287861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6815","nonce":3520287861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6813","nonce":3520287861}]},"public_addr":"172.21.15.111:6809/3520287861","cluster_addr":"172.21.15.111:6811/3520287861","heartbeat_back_addr":"172.21.15.111:6815/3520287861","heartbeat_front_addr":"172.21.15.111:6813/3520287861","state":["exists","up"]},{"osd":6,"uuid":"8be21e3d-b62e-4f99-bfcb-13a410bd4eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6817","nonce":718630314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6819","nonce":718630314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6823","nonce":718630314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6821","nonce":718630314}]},"public_addr":"172.21.15.111:6817/718630314","cluster_addr":"172.21.15.111:6819/718630314","heartbeat_back_addr":"172.21.15.111:6823/718630314","heartbeat_front_addr":"172.21.15.111:6821/718630314","state":["exists","up"]},{"osd":7,"uuid":"18f1582d-f05f-4d9f-a7c6-adc4131c86f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6825","nonce":949159104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6827","nonce":949159104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6831","nonce":949159104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6829","nonce":949159104}]},"public_addr":"172.21.15.111:6825/949159104","cluster_addr":"172.21.15.111:6827/949159104","heartbeat_back_addr":"172.21.15.111:6831/949159104","heartbeat_front_addr":"172.21.15.111:6829/949159104","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:39:42.920423+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:40:04.961191+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:40:32.061563+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:40:55.481013+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:41:14.677546+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:41:39.231899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:42:00.264299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:42:24.679273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.40:6801/2234583781":"2024-02-23T18:37:42.054346+0000","172.21.15.40:6800/2234583781":"2024-02-23T18:37:42.054346+0000","172.21.15.40:0/3802138041":"2024-02-23T18:37:42.054346+0000","172.21.15.40:0/3335014977":"2024-02-23T18:37:23.497986+0000","172.21.15.40:0/2606668330":"2024-02-23T18:37:42.054346+0000","172.21.15.40:0/3097014655":"2024-02-23T18:37:23.497986+0000","172.21.15.40:6800/4078705069":"2024-02-23T18:37:23.497986+0000","172.21.15.40:6801/4078705069":"2024-02-23T18:37:23.497986+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-22T18:43:33.910 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-22T18:43:33.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd dump --format=json 2024-02-22T18:43:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:33 smithi111 bash[14162]: audit 2024-02-22T18:43:33.247222+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.40:0/1281608905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T18:43:34.038 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:34.067 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:33 smithi040 bash[13988]: audit 2024-02-22T18:43:33.247222+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.40:0/1281608905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T18:43:34.067 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:33 smithi040 bash[17964]: audit 2024-02-22T18:43:33.247222+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.40:0/1281608905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T18:43:34.067 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:33 smithi040 bash[27270]: level=info ts=2024-02-22T18:43:33.695Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000906328s 2024-02-22T18:43:34.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:34 smithi111 bash[14162]: cluster 2024-02-22T18:43:34.612106+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v217: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:34.966 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:34 smithi040 bash[13988]: cluster 2024-02-22T18:43:34.612106+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v217: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:34.966 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:34 smithi040 bash[17964]: cluster 2024-02-22T18:43:34.612106+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v217: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:36.819 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:43:36.820 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"fsid":"42039b9c-d1b1-11ee-95bf-87774f69a715","created":"2024-02-22T18:37:00.494467+0000","modified":"2024-02-22T18:42:34.916751+0000","last_up_change":"2024-02-22T18:42:26.620417+0000","last_in_change":"2024-02-22T18:42:26.620417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T18:38:34.972392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"iscsi","create_time":"2024-02-22T18:42:30.826756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8a82ec4-54e0-41b7-9aee-587ee3cc94c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6803","nonce":2441240869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6805","nonce":2441240869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6809","nonce":2441240869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2441240869},{"type":"v1","addr":"172.21.15.40:6807","nonce":2441240869}]},"public_addr":"172.21.15.40:6803/2441240869","cluster_addr":"172.21.15.40:6805/2441240869","heartbeat_back_addr":"172.21.15.40:6809/2441240869","heartbeat_front_addr":"172.21.15.40:6807/2441240869","state":["exists","up"]},{"osd":1,"uuid":"ad58d21e-9da6-4d9d-92e6-30140338e2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6811","nonce":2470022647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6813","nonce":2470022647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6817","nonce":2470022647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2470022647},{"type":"v1","addr":"172.21.15.40:6815","nonce":2470022647}]},"public_addr":"172.21.15.40:6811/2470022647","cluster_addr":"172.21.15.40:6813/2470022647","heartbeat_back_addr":"172.21.15.40:6817/2470022647","heartbeat_front_addr":"172.21.15.40:6815/2470022647","state":["exists","up"]},{"osd":2,"uuid":"6c217ed3-b763-4e88-9c69-698c6f73d47d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6819","nonce":1820825800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6821","nonce":1820825800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6825","nonce":1820825800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1820825800},{"type":"v1","addr":"172.21.15.40:6823","nonce":1820825800}]},"public_addr":"172.21.15.40:6819/1820825800","cluster_addr":"172.21.15.40:6821/1820825800","heartbeat_back_addr":"172.21.15.40:6825/1820825800","heartbeat_front_addr":"172.21.15.40:6823/1820825800","state":["exists","up"]},{"osd":3,"uuid":"c2bc81e9-d620-44f8-87ab-e5936b9f42bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6827","nonce":3447321731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6829","nonce":3447321731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6833","nonce":3447321731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3447321731},{"type":"v1","addr":"172.21.15.40:6831","nonce":3447321731}]},"public_addr":"172.21.15.40:6827/3447321731","cluster_addr":"172.21.15.40:6829/3447321731","heartbeat_back_addr":"172.21.15.40:6833/3447321731","heartbeat_front_addr":"172.21.15.40:6831/3447321731","state":["exists","up"]},{"osd":4,"uuid":"64699f72-f560-4205-93e5-ce6cc4ee34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6801","nonce":1993784371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6803","nonce":1993784371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6807","nonce":1993784371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":1993784371},{"type":"v1","addr":"172.21.15.111:6805","nonce":1993784371}]},"public_addr":"172.21.15.111:6801/1993784371","cluster_addr":"172.21.15.111:6803/1993784371","heartbeat_back_addr":"172.21.15.111:6807/1993784371","heartbeat_front_addr":"172.21.15.111:6805/1993784371","state":["exists","up"]},{"osd":5,"uuid":"f071be67-ae85-4824-ba99-0ffec0951e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6809","nonce":3520287861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6811","nonce":3520287861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6815","nonce":3520287861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3520287861},{"type":"v1","addr":"172.21.15.111:6813","nonce":3520287861}]},"public_addr":"172.21.15.111:6809/3520287861","cluster_addr":"172.21.15.111:6811/3520287861","heartbeat_back_addr":"172.21.15.111:6815/3520287861","heartbeat_front_addr":"172.21.15.111:6813/3520287861","state":["exists","up"]},{"osd":6,"uuid":"8be21e3d-b62e-4f99-bfcb-13a410bd4eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6817","nonce":718630314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6819","nonce":718630314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6823","nonce":718630314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":718630314},{"type":"v1","addr":"172.21.15.111:6821","nonce":718630314}]},"public_addr":"172.21.15.111:6817/718630314","cluster_addr":"172.21.15.111:6819/718630314","heartbeat_back_addr":"172.21.15.111:6823/718630314","heartbeat_front_addr":"172.21.15.111:6821/718630314","state":["exists","up"]},{"osd":7,"uuid":"18f1582d-f05f-4d9f-a7c6-adc4131c86f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6825","nonce":949159104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6827","nonce":949159104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6831","nonce":949159104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":949159104},{"type":"v1","addr":"172.21.15.111:6829","nonce":949159104}]},"public_addr":"172.21.15.111:6825/949159104","cluster_addr":"172.21.15.111:6827/949159104","heartbeat_back_addr":"172.21.15.111:6831/949159104","heartbeat_front_addr":"172.21.15.111:6829/949159104","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:39:42.920423+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:40:04.961191+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:40:32.061563+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:40:55.481013+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:41:14.677546+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:41:39.231899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:42:00.264299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T18:42:24.679273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.40:6801/2234583781":"2024-02-23T18:37:42.054346+0000","172.21.15.40:6800/2234583781":"2024-02-23T18:37:42.054346+0000","172.21.15.40:0/3802138041":"2024-02-23T18:37:42.054346+0000","172.21.15.40:0/3335014977":"2024-02-23T18:37:23.497986+0000","172.21.15.40:0/2606668330":"2024-02-23T18:37:42.054346+0000","172.21.15.40:0/3097014655":"2024-02-23T18:37:23.497986+0000","172.21.15.40:6800/4078705069":"2024-02-23T18:37:23.497986+0000","172.21.15.40:6801/4078705069":"2024-02-23T18:37:23.497986+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-22T18:43:37.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-22T18:43:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:37.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:37 smithi040 bash[13988]: cluster 2024-02-22T18:43:36.612572+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v218: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:37.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:37 smithi040 bash[13988]: audit 2024-02-22T18:43:36.814783+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.40:0/357111038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T18:43:37.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:37 smithi040 bash[17964]: cluster 2024-02-22T18:43:36.612572+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v218: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:37.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:37 smithi040 bash[17964]: audit 2024-02-22T18:43:36.814783+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.40:0/357111038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T18:43:37.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:37 smithi111 bash[14162]: cluster 2024-02-22T18:43:36.612572+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v218: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:37.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:37 smithi111 bash[14162]: audit 2024-02-22T18:43:36.814783+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.40:0/357111038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T18:43:38.894 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:38 smithi040 bash[13988]: cluster 2024-02-22T18:43:38.613076+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v219: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:38.894 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:38 smithi040 bash[17964]: cluster 2024-02-22T18:43:38.613076+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v219: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:38.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:38 smithi111 bash[14162]: cluster 2024-02-22T18:43:38.613076+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v219: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:40.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:40 smithi040 bash[13988]: cluster 2024-02-22T18:43:40.613718+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v220: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:40.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:40 smithi040 bash[17964]: cluster 2024-02-22T18:43:40.613718+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v220: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:40.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:40 smithi111 bash[14162]: cluster 2024-02-22T18:43:40.613718+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v220: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:41.136 INFO:teuthology.orchestra.run.smithi040.stdout:42949673009 2024-02-22T18:43:41.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-22T18:43:41.267 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:42.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:42 smithi040 bash[13988]: cluster 2024-02-22T18:43:42.614353+0000 mgr.y (mgr.14138) 256 : cluster [DBG] pgmap v221: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:42.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:42 smithi040 bash[17964]: cluster 2024-02-22T18:43:42.614353+0000 mgr.y (mgr.14138) 256 : cluster [DBG] pgmap v221: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:42.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:42 smithi111 bash[14162]: cluster 2024-02-22T18:43:42.614353+0000 mgr.y (mgr.14138) 256 : cluster [DBG] pgmap v221: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:43 smithi111 bash[14162]: audit 2024-02-22T18:43:42.744519+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:43:43.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:43 smithi111 bash[14162]: audit 2024-02-22T18:43:42.760500+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:43:43.997 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:43 smithi040 bash[13988]: audit 2024-02-22T18:43:42.744519+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:43:43.997 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:43 smithi040 bash[13988]: audit 2024-02-22T18:43:42.760500+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:43:43.997 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:43 smithi040 bash[17964]: audit 2024-02-22T18:43:42.744519+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:43:43.997 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:43 smithi040 bash[17964]: audit 2024-02-22T18:43:42.760500+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:43:44.650 INFO:teuthology.orchestra.run.smithi040.stdout:68719476781 2024-02-22T18:43:44.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-22T18:43:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:44.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:44 smithi111 bash[14162]: cluster 2024-02-22T18:43:44.614968+0000 mgr.y (mgr.14138) 257 : cluster [DBG] pgmap v222: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:45.011 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:44 smithi040 bash[13988]: cluster 2024-02-22T18:43:44.614968+0000 mgr.y (mgr.14138) 257 : cluster [DBG] pgmap v222: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:45.011 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:44 smithi040 bash[17964]: cluster 2024-02-22T18:43:44.614968+0000 mgr.y (mgr.14138) 257 : cluster [DBG] pgmap v222: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:47.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[14162]: audit 2024-02-22T18:43:46.334977+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:47.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[14162]: audit 2024-02-22T18:43:46.338072+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:43:47.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[14162]: audit 2024-02-22T18:43:46.338480+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:43:47.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[14162]: cluster 2024-02-22T18:43:46.615374+0000 mgr.y (mgr.14138) 258 : cluster [DBG] pgmap v223: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:47.465 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-02-22T18:43:47.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:47 smithi040 bash[13988]: audit 2024-02-22T18:43:46.334977+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:47.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:47 smithi040 bash[13988]: audit 2024-02-22T18:43:46.338072+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:43:47.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:47 smithi040 bash[13988]: audit 2024-02-22T18:43:46.338480+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:43:47.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:47 smithi040 bash[13988]: cluster 2024-02-22T18:43:46.615374+0000 mgr.y (mgr.14138) 258 : cluster [DBG] pgmap v223: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:47.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:47 smithi040 bash[17964]: audit 2024-02-22T18:43:46.334977+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:47.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:47 smithi040 bash[17964]: audit 2024-02-22T18:43:46.338072+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:43:47.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:47 smithi040 bash[17964]: audit 2024-02-22T18:43:46.338480+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:43:47.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:47 smithi040 bash[17964]: cluster 2024-02-22T18:43:46.615374+0000 mgr.y (mgr.14138) 258 : cluster [DBG] pgmap v223: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:47.788 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-02-22T18:43:47.788 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-02-22T18:43:47.789 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-02-22T18:43:47.789 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-02-22T18:43:48.066 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-02-22T18:43:48.066 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-02-22T18:43:48.066 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-02-22T18:43:48.066 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-02-22T18:43:48.066 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:47 smithi111 bash[24494]: t=2024-02-22T18:43:47+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-22T18:43:48.066 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-02-22T18:43:48.334 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-02-22T18:43:48.335 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-02-22T18:43:48.335 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-02-22T18:43:48.335 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-02-22T18:43:48.387 INFO:teuthology.orchestra.run.smithi040.stdout:90194313258 2024-02-22T18:43:48.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-22T18:43:48.522 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:48.550 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:48 smithi040 bash[13988]: audit 2024-02-22T18:43:47.425329+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:48.550 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:48 smithi040 bash[13988]: cephadm 2024-02-22T18:43:47.426166+0000 mgr.y (mgr.14138) 259 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:43:48.550 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:48 smithi040 bash[13988]: audit 2024-02-22T18:43:47.930762+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:48.550 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:48 smithi040 bash[13988]: audit 2024-02-22T18:43:47.936801+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:48.550 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:48 smithi040 bash[17964]: audit 2024-02-22T18:43:47.425329+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:48.550 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:48 smithi040 bash[17964]: cephadm 2024-02-22T18:43:47.426166+0000 mgr.y (mgr.14138) 259 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:43:48.551 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:48 smithi040 bash[17964]: audit 2024-02-22T18:43:47.930762+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:48.551 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:48 smithi040 bash[17964]: audit 2024-02-22T18:43:47.936801+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:48.595 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-02-22T18:43:48.595 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-02-22T18:43:48.595 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-02-22T18:43:48.595 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-02-22T18:43:48.595 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-02-22T18:43:48.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[14162]: audit 2024-02-22T18:43:47.425329+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:48.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[14162]: cephadm 2024-02-22T18:43:47.426166+0000 mgr.y (mgr.14138) 259 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:43:48.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[14162]: audit 2024-02-22T18:43:47.930762+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:48.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[14162]: audit 2024-02-22T18:43:47.936801+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:48.872 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-02-22T18:43:48.872 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-02-22T18:43:48.872 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-02-22T18:43:48.872 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-02-22T18:43:49.157 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-02-22T18:43:49.157 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-02-22T18:43:49.157 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:48 smithi111 bash[24494]: t=2024-02-22T18:43:48+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-02-22T18:43:49.157 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-02-22T18:43:49.439 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-02-22T18:43:49.439 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-02-22T18:43:49.439 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-02-22T18:43:49.439 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-02-22T18:43:49.699 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:49 smithi040 bash[13988]: cephadm 2024-02-22T18:43:47.944854+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-22T18:43:49.699 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:49 smithi040 bash[13988]: cephadm 2024-02-22T18:43:47.949798+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi040 2024-02-22T18:43:49.699 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:49 smithi040 bash[13988]: cluster 2024-02-22T18:43:48.616052+0000 mgr.y (mgr.14138) 262 : cluster [DBG] pgmap v224: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:49.699 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:49 smithi040 bash[17964]: cephadm 2024-02-22T18:43:47.944854+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-22T18:43:49.699 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:49 smithi040 bash[17964]: cephadm 2024-02-22T18:43:47.949798+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi040 2024-02-22T18:43:49.699 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:49 smithi040 bash[17964]: cluster 2024-02-22T18:43:48.616052+0000 mgr.y (mgr.14138) 262 : cluster [DBG] pgmap v224: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:49.710 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[14162]: cephadm 2024-02-22T18:43:47.944854+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-22T18:43:49.710 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[14162]: cephadm 2024-02-22T18:43:47.949798+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi040 2024-02-22T18:43:49.710 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[14162]: cluster 2024-02-22T18:43:48.616052+0000 mgr.y (mgr.14138) 262 : cluster [DBG] pgmap v224: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:49.711 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-02-22T18:43:49.711 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-02-22T18:43:49.711 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-02-22T18:43:49.964 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-02-22T18:43:49.965 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-02-22T18:43:49.965 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-22T18:43:49.965 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-02-22T18:43:49.965 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:49 smithi111 bash[24494]: t=2024-02-22T18:43:49+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-02-22T18:43:50.331 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-02-22T18:43:50.331 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-02-22T18:43:50.331 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-02-22T18:43:50.331 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-02-22T18:43:50.331 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-02-22T18:43:50.599 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-02-22T18:43:50.599 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-02-22T18:43:50.599 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-02-22T18:43:50.599 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-02-22T18:43:50.876 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[14162]: cluster 2024-02-22T18:43:50.616723+0000 mgr.y (mgr.14138) 263 : cluster [DBG] pgmap v225: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:50.876 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-02-22T18:43:50.876 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-02-22T18:43:50.876 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-02-22T18:43:50.876 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-02-22T18:43:50.877 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-02-22T18:43:50.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:50 smithi040 bash[13988]: cluster 2024-02-22T18:43:50.616723+0000 mgr.y (mgr.14138) 263 : cluster [DBG] pgmap v225: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:50.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:50 smithi040 bash[17964]: cluster 2024-02-22T18:43:50.616723+0000 mgr.y (mgr.14138) 263 : cluster [DBG] pgmap v225: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:51.136 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:50 smithi111 bash[24494]: t=2024-02-22T18:43:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-02-22T18:43:51.136 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-02-22T18:43:51.136 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-02-22T18:43:51.388 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-02-22T18:43:51.388 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-02-22T18:43:51.388 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-02-22T18:43:51.388 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-02-22T18:43:51.388 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-02-22T18:43:51.388 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-22T18:43:51.681 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-02-22T18:43:51.681 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-22T18:43:51.681 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-02-22T18:43:51.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-22T18:43:51.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-22T18:43:51.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-02-22T18:43:51.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-02-22T18:43:52.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-02-22T18:43:52.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:51 smithi111 bash[24494]: t=2024-02-22T18:43:51+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-02-22T18:43:52.215 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-02-22T18:43:52.215 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-02-22T18:43:52.215 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-02-22T18:43:52.529 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-02-22T18:43:52.529 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-02-22T18:43:52.529 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-02-22T18:43:52.529 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-02-22T18:43:52.530 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-02-22T18:43:52.530 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-22T18:43:52.823 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[14162]: cluster 2024-02-22T18:43:52.617320+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v226: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:52.823 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-02-22T18:43:52.823 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-02-22T18:43:52.823 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-02-22T18:43:52.823 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-02-22T18:43:52.977 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:52 smithi040 bash[17964]: cluster 2024-02-22T18:43:52.617320+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v226: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:52.977 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:52 smithi040 bash[13988]: cluster 2024-02-22T18:43:52.617320+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v226: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:53.074 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-02-22T18:43:53.074 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-02-22T18:43:53.075 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:52 smithi111 bash[24494]: t=2024-02-22T18:43:52+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-02-22T18:43:53.075 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-02-22T18:43:53.419 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-02-22T18:43:53.419 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-02-22T18:43:53.419 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-02-22T18:43:53.419 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-02-22T18:43:53.419 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-02-22T18:43:53.419 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-02-22T18:43:53.687 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-02-22T18:43:53.687 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-02-22T18:43:53.687 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-02-22T18:43:53.687 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-02-22T18:43:53.955 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-02-22T18:43:53.955 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-02-22T18:43:54.117 INFO:teuthology.orchestra.run.smithi040.stdout:111669149734 2024-02-22T18:43:54.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-22T18:43:54.206 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:53 smithi111 bash[24494]: t=2024-02-22T18:43:53+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-02-22T18:43:54.207 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-02-22T18:43:54.207 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-02-22T18:43:54.207 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-02-22T18:43:54.207 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-02-22T18:43:54.250 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:54.429 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:54 smithi040 systemd[1]: Stopping Ceph alertmanager.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T18:43:54.429 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:54 smithi040 bash[27270]: level=info ts=2024-02-22T18:43:54.155Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2024-02-22T18:43:54.464 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-02-22T18:43:54.464 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-02-22T18:43:54.465 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-02-22T18:43:54.802 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[14162]: cluster 2024-02-22T18:43:54.617988+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v227: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:54.802 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-22T18:43:54.802 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-22T18:43:54.803 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-02-22T18:43:54.803 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-02-22T18:43:54.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:54 smithi040 bash[13988]: cluster 2024-02-22T18:43:54.617988+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v227: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:54.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:54 smithi040 bash[17964]: cluster 2024-02-22T18:43:54.617988+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v227: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:55.087 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-02-22T18:43:55.088 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-02-22T18:43:55.088 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-22T18:43:55.088 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:54 smithi111 bash[24494]: t=2024-02-22T18:43:54+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-02-22T18:43:55.088 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-02-22T18:43:55.088 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-22T18:43:55.364 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-02-22T18:43:55.364 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-02-22T18:43:55.364 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-02-22T18:43:55.611 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:55 smithi040 docker[29175]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-alertmanager.a 2024-02-22T18:43:55.632 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-02-22T18:43:55.633 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-02-22T18:43:55.633 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-02-22T18:43:55.633 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-02-22T18:43:55.909 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-02-22T18:43:55.909 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-02-22T18:43:55.910 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-02-22T18:43:55.910 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-02-22T18:43:55.910 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:55 smithi111 bash[24494]: t=2024-02-22T18:43:55+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-02-22T18:43:55.929 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:55 smithi040 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-22T18:43:55.929 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:55 smithi040 systemd[1]: Stopped Ceph alertmanager.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:43:55.929 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:55 smithi040 systemd[1]: Started Ceph alertmanager.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:43:56.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:56 smithi111 bash[24494]: t=2024-02-22T18:43:56+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-02-22T18:43:56.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:56 smithi111 bash[24494]: t=2024-02-22T18:43:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-02-22T18:43:56.812 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:56 smithi040 bash[13988]: audit 2024-02-22T18:43:55.641239+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:56.812 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:56 smithi040 bash[13988]: cephadm 2024-02-22T18:43:55.643086+0000 mgr.y (mgr.14138) 266 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T18:43:56.812 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:56 smithi040 bash[13988]: cephadm 2024-02-22T18:43:55.647719+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi111 2024-02-22T18:43:56.812 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:56 smithi040 bash[13988]: cluster 2024-02-22T18:43:56.618468+0000 mgr.y (mgr.14138) 268 : cluster [DBG] pgmap v228: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:56.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:56 smithi040 bash[17964]: audit 2024-02-22T18:43:55.641239+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:56.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:56 smithi040 bash[17964]: cephadm 2024-02-22T18:43:55.643086+0000 mgr.y (mgr.14138) 266 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T18:43:56.813 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:56 smithi040 bash[17964]: cephadm 2024-02-22T18:43:55.647719+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi111 2024-02-22T18:43:56.813 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:56 smithi040 bash[17964]: cluster 2024-02-22T18:43:56.618468+0000 mgr.y (mgr.14138) 268 : cluster [DBG] pgmap v228: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:56.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:56 smithi111 bash[14162]: audit 2024-02-22T18:43:55.641239+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:43:56.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:56 smithi111 bash[14162]: cephadm 2024-02-22T18:43:55.643086+0000 mgr.y (mgr.14138) 266 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T18:43:56.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:56 smithi111 bash[14162]: cephadm 2024-02-22T18:43:55.647719+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi111 2024-02-22T18:43:56.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:56 smithi111 bash[14162]: cluster 2024-02-22T18:43:56.618468+0000 mgr.y (mgr.14138) 268 : cluster [DBG] pgmap v228: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:43:56.965 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:56 smithi111 bash[24494]: t=2024-02-22T18:43:56+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-02-22T18:43:56.965 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:56 smithi111 bash[24494]: t=2024-02-22T18:43:56+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-02-22T18:43:57.435 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:57 smithi111 bash[24494]: t=2024-02-22T18:43:57+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-02-22T18:43:57.435 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:57 smithi111 bash[24494]: t=2024-02-22T18:43:57+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-02-22T18:43:57.598 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:57 smithi040 bash[29235]: level=info ts=2024-02-22T18:43:57.380Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2024-02-22T18:43:57.598 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:57 smithi040 bash[29235]: level=info ts=2024-02-22T18:43:57.380Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2024-02-22T18:43:57.598 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:57 smithi040 bash[29235]: level=info ts=2024-02-22T18:43:57.382Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.40 port=9094 2024-02-22T18:43:57.598 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:57 smithi040 bash[29235]: level=info ts=2024-02-22T18:43:57.383Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-22T18:43:57.598 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:57 smithi040 bash[29235]: level=info ts=2024-02-22T18:43:57.424Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-22T18:43:57.599 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:57 smithi040 bash[29235]: level=info ts=2024-02-22T18:43:57.425Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-22T18:43:57.599 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:57 smithi040 bash[29235]: level=info ts=2024-02-22T18:43:57.429Z caller=main.go:497 msg=Listening address=:9093 2024-02-22T18:43:57.713 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:57 smithi111 bash[24494]: t=2024-02-22T18:43:57+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-02-22T18:43:57.713 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:57 smithi111 bash[24494]: t=2024-02-22T18:43:57+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-02-22T18:43:57.964 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:57 smithi111 bash[24494]: t=2024-02-22T18:43:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-22T18:43:57.964 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:57 smithi111 bash[24494]: t=2024-02-22T18:43:57+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-02-22T18:43:57.964 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:57 smithi111 bash[24494]: t=2024-02-22T18:43:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-02-22T18:43:57.965 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:57 smithi111 bash[24494]: t=2024-02-22T18:43:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-02-22T18:43:58.360 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:58 smithi111 bash[24494]: t=2024-02-22T18:43:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-02-22T18:43:58.360 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:58 smithi111 bash[24494]: t=2024-02-22T18:43:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-02-22T18:43:58.697 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:58 smithi111 bash[24494]: t=2024-02-22T18:43:58+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-02-22T18:43:58.916 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:43:58 smithi040 bash[17964]: cluster 2024-02-22T18:43:58.619034+0000 mgr.y (mgr.14138) 269 : cluster [DBG] pgmap v229: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:58.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:43:58 smithi040 bash[13988]: cluster 2024-02-22T18:43:58.619034+0000 mgr.y (mgr.14138) 269 : cluster [DBG] pgmap v229: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:58.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:43:58 smithi111 bash[14162]: cluster 2024-02-22T18:43:58.619034+0000 mgr.y (mgr.14138) 269 : cluster [DBG] pgmap v229: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:43:58.965 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:58 smithi111 bash[24494]: t=2024-02-22T18:43:58+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-02-22T18:43:59.400 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:58 smithi111 bash[24494]: t=2024-02-22T18:43:58+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-02-22T18:43:59.400 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:59 smithi111 bash[24494]: t=2024-02-22T18:43:59+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-02-22T18:43:59.498 INFO:teuthology.orchestra.run.smithi040.stdout:133143986211 2024-02-22T18:43:59.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-22T18:43:59.629 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:43:59.656 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:43:59 smithi040 bash[29235]: level=info ts=2024-02-22T18:43:59.383Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000175746s 2024-02-22T18:43:59.663 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:59 smithi111 bash[24494]: t=2024-02-22T18:43:59+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-22T18:43:59.964 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:43:59 smithi111 bash[24494]: t=2024-02-22T18:43:59+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-02-22T18:44:00.331 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:00 smithi111 bash[24494]: t=2024-02-22T18:44:00+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-02-22T18:44:00.331 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:00 smithi111 bash[24494]: t=2024-02-22T18:44:00+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-22T18:44:00.591 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:00 smithi111 bash[24494]: t=2024-02-22T18:44:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-02-22T18:44:00.591 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:00 smithi111 bash[24494]: t=2024-02-22T18:44:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-02-22T18:44:00.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:00 smithi040 bash[17964]: cluster 2024-02-22T18:44:00.619689+0000 mgr.y (mgr.14138) 270 : cluster [DBG] pgmap v230: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:00.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:00 smithi040 bash[13988]: cluster 2024-02-22T18:44:00.619689+0000 mgr.y (mgr.14138) 270 : cluster [DBG] pgmap v230: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:00.894 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:00 smithi111 bash[14162]: cluster 2024-02-22T18:44:00.619689+0000 mgr.y (mgr.14138) 270 : cluster [DBG] pgmap v230: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:00.894 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:00 smithi111 bash[24494]: t=2024-02-22T18:44:00+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-02-22T18:44:00.895 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:00 smithi111 bash[24494]: t=2024-02-22T18:44:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-02-22T18:44:00.895 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:00 smithi111 bash[24494]: t=2024-02-22T18:44:00+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-02-22T18:44:01.196 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:00 smithi111 bash[24494]: t=2024-02-22T18:44:00+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-02-22T18:44:01.196 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[24494]: t=2024-02-22T18:44:01+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-02-22T18:44:01.464 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[24494]: t=2024-02-22T18:44:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-02-22T18:44:01.832 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[24494]: t=2024-02-22T18:44:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-02-22T18:44:01.832 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[24494]: t=2024-02-22T18:44:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-02-22T18:44:02.103 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[24494]: t=2024-02-22T18:44:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-02-22T18:44:02.103 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[24494]: t=2024-02-22T18:44:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 systemd[1]: Stopping Ceph prometheus.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=warn ts=2024-02-22T18:44:01.977Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=main.go:561 msg="Stopping notify discovery manager..." 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=main.go:583 msg="Stopping scrape manager..." 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=main.go:543 msg="Scrape discovery manager stopped" 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=main.go:577 msg="Scrape manager stopped" 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=main.go:557 msg="Notify discovery manager stopped" 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2024-02-22T18:44:02.104 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.977Z caller=main.go:749 msg="Notifier manager stopped" 2024-02-22T18:44:02.105 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:01 smithi111 bash[23664]: level=info ts=2024-02-22T18:44:01.978Z caller=main.go:761 msg="See you next time!" 2024-02-22T18:44:02.513 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:02 smithi111 bash[24494]: t=2024-02-22T18:44:02+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-02-22T18:44:02.514 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:02 smithi111 bash[24494]: t=2024-02-22T18:44:02+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-02-22T18:44:02.858 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:02 smithi111 bash[14162]: cluster 2024-02-22T18:44:02.620384+0000 mgr.y (mgr.14138) 271 : cluster [DBG] pgmap v231: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:02.859 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:02 smithi111 bash[24494]: t=2024-02-22T18:44:02+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-02-22T18:44:02.859 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:02 smithi111 docker[24989]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-prometheus.a 2024-02-22T18:44:02.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:02 smithi040 bash[13988]: cluster 2024-02-22T18:44:02.620384+0000 mgr.y (mgr.14138) 271 : cluster [DBG] pgmap v231: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:02.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:02 smithi040 bash[17964]: cluster 2024-02-22T18:44:02.620384+0000 mgr.y (mgr.14138) 271 : cluster [DBG] pgmap v231: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:03.030 INFO:teuthology.orchestra.run.smithi040.stdout:154618822687 2024-02-22T18:44:03.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-22T18:44:03.178 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:03.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:02 smithi111 bash[24494]: t=2024-02-22T18:44:02+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-02-22T18:44:03.215 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:03 smithi111 bash[24494]: t=2024-02-22T18:44:03+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-02-22T18:44:03.215 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:03 smithi111 bash[24494]: t=2024-02-22T18:44:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-22T18:44:03.215 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:03 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@prometheus.a.service: Succeeded. 2024-02-22T18:44:03.215 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:03 smithi111 systemd[1]: Stopped Ceph prometheus.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:44:03.215 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:03 smithi111 systemd[1]: Started Ceph prometheus.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:44:03.964 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:03 smithi111 bash[24494]: t=2024-02-22T18:44:03+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-02-22T18:44:04.271 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[24494]: t=2024-02-22T18:44:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.072495+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.078071+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.078831+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.080670+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040:9093"}]: dispatch 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.081238+0000 mgr.y (mgr.14138) 273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040:9093"}]: dispatch 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.089158+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.097710+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.098529+0000 mgr.y (mgr.14138) 274 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: cephadm 2024-02-22T18:44:03.109595+0000 mgr.y (mgr.14138) 275 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.111:5000 to Dashboard 2024-02-22T18:44:04.272 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.110054+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.110785+0000 mgr.y (mgr.14138) 276 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.116793+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.120725+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "service_url": "http://user:password@172.21.15.111:5000", "name": "smithi111"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.121607+0000 mgr.y (mgr.14138) 277 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "service_url": "http://user:password@172.21.15.111:5000", "name": "smithi111"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.133191+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.138891+0000 mon.a (mon.0) 600 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.139338+0000 mgr.y (mgr.14138) 278 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.140563+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111:9095"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.141039+0000 mgr.y (mgr.14138) 279 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111:9095"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.146902+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.155133+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.155795+0000 mgr.y (mgr.14138) 280 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.163706+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111:3000"}]: dispatch 2024-02-22T18:44:04.273 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.164207+0000 mgr.y (mgr.14138) 281 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111:3000"}]: dispatch 2024-02-22T18:44:04.274 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.170459+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.274 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.176785+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:04.274 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[14162]: audit 2024-02-22T18:44:03.177355+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:04.383 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.072495+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.383 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.078071+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T18:44:04.383 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.078831+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T18:44:04.383 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.080670+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040:9093"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.081238+0000 mgr.y (mgr.14138) 273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040:9093"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.089158+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.097710+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.098529+0000 mgr.y (mgr.14138) 274 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: cephadm 2024-02-22T18:44:03.109595+0000 mgr.y (mgr.14138) 275 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.111:5000 to Dashboard 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.110054+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.110785+0000 mgr.y (mgr.14138) 276 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.116793+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.120725+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "service_url": "http://user:password@172.21.15.111:5000", "name": "smithi111"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.121607+0000 mgr.y (mgr.14138) 277 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "service_url": "http://user:password@172.21.15.111:5000", "name": "smithi111"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.133191+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.138891+0000 mon.a (mon.0) 600 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.139338+0000 mgr.y (mgr.14138) 278 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:44:04.384 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.140563+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111:9095"}]: dispatch 2024-02-22T18:44:04.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.141039+0000 mgr.y (mgr.14138) 279 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111:9095"}]: dispatch 2024-02-22T18:44:04.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.146902+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.155133+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T18:44:04.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.155795+0000 mgr.y (mgr.14138) 280 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T18:44:04.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.163706+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111:3000"}]: dispatch 2024-02-22T18:44:04.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.164207+0000 mgr.y (mgr.14138) 281 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111:3000"}]: dispatch 2024-02-22T18:44:04.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.170459+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.176785+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:04.385 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[13988]: audit 2024-02-22T18:44:03.177355+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.072495+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.078071+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.078831+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.080670+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040:9093"}]: dispatch 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.081238+0000 mgr.y (mgr.14138) 273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040:9093"}]: dispatch 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.089158+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.097710+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.098529+0000 mgr.y (mgr.14138) 274 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: cephadm 2024-02-22T18:44:03.109595+0000 mgr.y (mgr.14138) 275 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.111:5000 to Dashboard 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.110054+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.110785+0000 mgr.y (mgr.14138) 276 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.116793+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.386 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.120725+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "service_url": "http://user:password@172.21.15.111:5000", "name": "smithi111"}]: dispatch 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.121607+0000 mgr.y (mgr.14138) 277 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "service_url": "http://user:password@172.21.15.111:5000", "name": "smithi111"}]: dispatch 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.133191+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.138891+0000 mon.a (mon.0) 600 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.139338+0000 mgr.y (mgr.14138) 278 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.140563+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111:9095"}]: dispatch 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.141039+0000 mgr.y (mgr.14138) 279 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111:9095"}]: dispatch 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.146902+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.155133+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.155795+0000 mgr.y (mgr.14138) 280 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T18:44:04.387 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.163706+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111:3000"}]: dispatch 2024-02-22T18:44:04.388 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.164207+0000 mgr.y (mgr.14138) 281 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111:3000"}]: dispatch 2024-02-22T18:44:04.388 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.170459+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:04.388 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.176785+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:04.388 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:04 smithi040 bash[17964]: audit 2024-02-22T18:44:03.177355+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:04.464 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[24494]: t=2024-02-22T18:44:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-02-22T18:44:04.465 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[24494]: t=2024-02-22T18:44:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-02-22T18:44:04.814 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[24494]: t=2024-02-22T18:44:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-02-22T18:44:04.814 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[24494]: t=2024-02-22T18:44:04+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-02-22T18:44:04.815 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[24494]: t=2024-02-22T18:44:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-02-22T18:44:05.127 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[24494]: t=2024-02-22T18:44:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-02-22T18:44:05.127 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[24494]: t=2024-02-22T18:44:04+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-02-22T18:44:05.127 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.956Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.956Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.956Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.956Z caller=main.go:339 host_details="(Linux 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 smithi111 (none))" 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.956Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.956Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.958Z caller=main.go:678 msg="Starting TSDB ..." 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.958Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.963Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2024-02-22T18:44:05.128 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.963Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-02-22T18:44:05.129 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.963Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-02-22T18:44:05.129 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.963Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=590.816µs 2024-02-22T18:44:05.129 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.965Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2024-02-22T18:44:05.129 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.965Z caller=main.go:695 msg="TSDB started" 2024-02-22T18:44:05.129 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.965Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-22T18:44:05.129 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.967Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-22T18:44:05.129 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:44:04 smithi111 bash[25036]: level=info ts=2024-02-22T18:44:04.967Z caller=main.go:646 msg="Server is ready to receive web requests." 2024-02-22T18:44:05.379 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-02-22T18:44:05.379 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-22T18:44:05.379 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-22T18:44:05.379 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[14162]: audit 2024-02-22T18:44:04.325029+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:05.380 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[14162]: cluster 2024-02-22T18:44:04.621050+0000 mgr.y (mgr.14138) 282 : cluster [DBG] pgmap v232: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:05.648 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-22T18:44:05.648 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-22T18:44:05.648 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-02-22T18:44:05.648 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-02-22T18:44:05.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:05 smithi040 bash[17964]: audit 2024-02-22T18:44:04.325029+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:05.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:05 smithi040 bash[17964]: cluster 2024-02-22T18:44:04.621050+0000 mgr.y (mgr.14138) 282 : cluster [DBG] pgmap v232: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:05 smithi040 bash[13988]: audit 2024-02-22T18:44:04.325029+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:05 smithi040 bash[13988]: cluster 2024-02-22T18:44:04.621050+0000 mgr.y (mgr.14138) 282 : cluster [DBG] pgmap v232: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:05.908 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-02-22T18:44:05.908 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-22T18:44:05.908 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-02-22T18:44:05.908 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-02-22T18:44:06.184 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:05 smithi111 bash[24494]: t=2024-02-22T18:44:05+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-02-22T18:44:06.184 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-02-22T18:44:06.185 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-02-22T18:44:06.185 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-02-22T18:44:06.467 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-02-22T18:44:06.467 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-02-22T18:44:06.467 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-02-22T18:44:06.467 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-02-22T18:44:06.651 INFO:teuthology.orchestra.run.smithi040.stdout:176093659163 2024-02-22T18:44:06.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-22T18:44:06.739 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[14162]: audit 2024-02-22T18:44:05.513653+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:06.740 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[14162]: cephadm 2024-02-22T18:44:05.514861+0000 mgr.y (mgr.14138) 283 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:44:06.740 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[14162]: audit 2024-02-22T18:44:05.876496+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:06.740 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[14162]: audit 2024-02-22T18:44:05.884690+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:06.740 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[14162]: audit 2024-02-22T18:44:05.885390+0000 mon.a (mon.0) 612 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:06.740 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-02-22T18:44:06.740 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-02-22T18:44:06.740 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-02-22T18:44:06.740 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-02-22T18:44:06.778 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:06.799 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[13988]: audit 2024-02-22T18:44:05.513653+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:06.799 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[13988]: cephadm 2024-02-22T18:44:05.514861+0000 mgr.y (mgr.14138) 283 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:44:06.799 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[13988]: audit 2024-02-22T18:44:05.876496+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:06.800 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[13988]: audit 2024-02-22T18:44:05.884690+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:06.800 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[13988]: audit 2024-02-22T18:44:05.885390+0000 mon.a (mon.0) 612 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:06.800 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[17964]: audit 2024-02-22T18:44:05.513653+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:06.800 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[17964]: cephadm 2024-02-22T18:44:05.514861+0000 mgr.y (mgr.14138) 283 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:44:06.800 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[17964]: audit 2024-02-22T18:44:05.876496+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:06.800 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[17964]: audit 2024-02-22T18:44:05.884690+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:06.800 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:06 smithi040 bash[17964]: audit 2024-02-22T18:44:05.885390+0000 mon.a (mon.0) 612 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:44:07.033 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-22T18:44:07.033 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-22T18:44:07.033 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-02-22T18:44:07.033 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:06 smithi111 bash[24494]: t=2024-02-22T18:44:06+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-02-22T18:44:07.176 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-02-22T18:44:07.176 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-02-22T18:44:07.286 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-02-22T18:44:07.286 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-02-22T18:44:07.596 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-22T18:44:07.597 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-02-22T18:44:07.597 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-02-22T18:44:07.597 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-02-22T18:44:07.597 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-02-22T18:44:07.597 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-02-22T18:44:07.624 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:44:07 smithi040 bash[29235]: level=info ts=2024-02-22T18:44:07.384Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000797734s 2024-02-22T18:44:07.627 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:07 smithi040 bash[17964]: cluster 2024-02-22T18:44:06.621619+0000 mgr.y (mgr.14138) 284 : cluster [DBG] pgmap v233: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:07.627 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:07 smithi040 bash[17964]: audit 2024-02-22T18:44:07.325782+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:07.627 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:07 smithi040 bash[17964]: audit 2024-02-22T18:44:07.453042+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:07.627 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:07 smithi040 bash[17964]: audit 2024-02-22T18:44:07.458834+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:07.628 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:07 smithi040 bash[13988]: cluster 2024-02-22T18:44:06.621619+0000 mgr.y (mgr.14138) 284 : cluster [DBG] pgmap v233: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:07.628 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:07 smithi040 bash[13988]: audit 2024-02-22T18:44:07.325782+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:07.628 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:07 smithi040 bash[13988]: audit 2024-02-22T18:44:07.453042+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:07.628 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:07 smithi040 bash[13988]: audit 2024-02-22T18:44:07.458834+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:07.890 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-22T18:44:07.890 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-02-22T18:44:07.890 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-02-22T18:44:07.890 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[14162]: cluster 2024-02-22T18:44:06.621619+0000 mgr.y (mgr.14138) 284 : cluster [DBG] pgmap v233: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:07.890 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[14162]: audit 2024-02-22T18:44:07.325782+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:07.891 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[14162]: audit 2024-02-22T18:44:07.453042+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:07.891 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[14162]: audit 2024-02-22T18:44:07.458834+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:08.158 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-02-22T18:44:08.158 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:07 smithi111 bash[24494]: t=2024-02-22T18:44:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-02-22T18:44:08.158 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-02-22T18:44:08.158 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-02-22T18:44:08.461 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-02-22T18:44:08.461 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-02-22T18:44:08.461 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-02-22T18:44:08.461 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-02-22T18:44:08.461 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-02-22T18:44:08.461 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-02-22T18:44:08.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[14162]: cluster 2024-02-22T18:44:08.622292+0000 mgr.y (mgr.14138) 285 : cluster [DBG] pgmap v234: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing HTTPServer" logger=server 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing PluginManager" logger=server 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Starting plugin search" logger=plugins 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing HooksService" logger=server 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2024-02-22T18:44:08.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing RemoteCache" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing QuotaService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing ServerLockService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing RenderingService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing AlertEngine" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing LoginService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing SearchService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing TracingService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing CleanUpService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing NotificationService" logger=server 2024-02-22T18:44:08.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2024-02-22T18:44:08.717 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-02-22T18:44:08.717 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2024-02-22T18:44:08.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:08 smithi040 bash[13988]: cluster 2024-02-22T18:44:08.622292+0000 mgr.y (mgr.14138) 285 : cluster [DBG] pgmap v234: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:08.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:08 smithi040 bash[17964]: cluster 2024-02-22T18:44:08.622292+0000 mgr.y (mgr.14138) 285 : cluster [DBG] pgmap v234: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:09.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2024-02-22T18:44:09.215 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2024-02-22T18:44:09.215 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="Initializing Stream Manager" 2024-02-22T18:44:09.215 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 18:44:08 smithi111 bash[24494]: t=2024-02-22T18:44:08+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-02-22T18:44:10.484 INFO:teuthology.orchestra.run.smithi040.stdout:197568495639 2024-02-22T18:44:10.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-22T18:44:10.613 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:10.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:10 smithi040 bash[17964]: cluster 2024-02-22T18:44:10.623069+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v235: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:44:10.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:10 smithi040 bash[13988]: cluster 2024-02-22T18:44:10.623069+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v235: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:44:10.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:10 smithi111 bash[14162]: cluster 2024-02-22T18:44:10.623069+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v235: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:44:12.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:12 smithi111 bash[14162]: cluster 2024-02-22T18:44:12.623773+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v236: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:44:13.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:12 smithi040 bash[13988]: cluster 2024-02-22T18:44:12.623773+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v236: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:44:13.137 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:12 smithi040 bash[17964]: cluster 2024-02-22T18:44:12.623773+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v236: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:44:13.484 INFO:teuthology.orchestra.run.smithi040.stdout:42949673016 2024-02-22T18:44:13.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:13 smithi040 bash[13988]: audit 2024-02-22T18:44:13.480808+0000 mon.a (mon.0) 616 : audit [DBG] from='client.? 172.21.15.40:0/2945990257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-22T18:44:13.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:13 smithi040 bash[17964]: audit 2024-02-22T18:44:13.480808+0000 mon.a (mon.0) 616 : audit [DBG] from='client.? 172.21.15.40:0/2945990257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-22T18:44:13.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:13 smithi111 bash[14162]: audit 2024-02-22T18:44:13.480808+0000 mon.a (mon.0) 616 : audit [DBG] from='client.? 172.21.15.40:0/2945990257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-22T18:44:14.298 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673009 got 42949673016 for osd.0 2024-02-22T18:44:14.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-22T18:44:14.429 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:15.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:14 smithi040 bash[13988]: cluster 2024-02-22T18:44:14.624516+0000 mgr.y (mgr.14138) 288 : cluster [DBG] pgmap v237: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:15.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:14 smithi040 bash[17964]: cluster 2024-02-22T18:44:14.624516+0000 mgr.y (mgr.14138) 288 : cluster [DBG] pgmap v237: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:15.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:14 smithi111 bash[14162]: cluster 2024-02-22T18:44:14.624516+0000 mgr.y (mgr.14138) 288 : cluster [DBG] pgmap v237: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:17.148 INFO:teuthology.orchestra.run.smithi040.stdout:68719476787 2024-02-22T18:44:17.820 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476781 got 68719476787 for osd.1 2024-02-22T18:44:17.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-22T18:44:17.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:17 smithi040 bash[13988]: cluster 2024-02-22T18:44:16.625129+0000 mgr.y (mgr.14138) 289 : cluster [DBG] pgmap v238: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:17.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:17 smithi040 bash[13988]: audit 2024-02-22T18:44:17.144817+0000 mon.a (mon.0) 617 : audit [DBG] from='client.? 172.21.15.40:0/339733657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-22T18:44:17.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:17 smithi040 bash[17964]: cluster 2024-02-22T18:44:16.625129+0000 mgr.y (mgr.14138) 289 : cluster [DBG] pgmap v238: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:17.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:17 smithi040 bash[17964]: audit 2024-02-22T18:44:17.144817+0000 mon.a (mon.0) 617 : audit [DBG] from='client.? 172.21.15.40:0/339733657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-22T18:44:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:17.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:17 smithi111 bash[14162]: cluster 2024-02-22T18:44:16.625129+0000 mgr.y (mgr.14138) 289 : cluster [DBG] pgmap v238: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:17.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:17 smithi111 bash[14162]: audit 2024-02-22T18:44:17.144817+0000 mon.a (mon.0) 617 : audit [DBG] from='client.? 172.21.15.40:0/339733657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-22T18:44:18.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:18 smithi111 bash[14162]: cluster 2024-02-22T18:44:18.625783+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v239: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:18.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:18 smithi040 bash[13988]: cluster 2024-02-22T18:44:18.625783+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v239: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:18.986 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:18 smithi040 bash[17964]: cluster 2024-02-22T18:44:18.625783+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v239: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:20.785 INFO:teuthology.orchestra.run.smithi040.stdout:90194313265 2024-02-22T18:44:20.963 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:20 smithi040 bash[13988]: cluster 2024-02-22T18:44:20.626191+0000 mgr.y (mgr.14138) 291 : cluster [DBG] pgmap v240: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:20.964 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:20 smithi040 bash[17964]: cluster 2024-02-22T18:44:20.626191+0000 mgr.y (mgr.14138) 291 : cluster [DBG] pgmap v240: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:20 smithi111 bash[14162]: cluster 2024-02-22T18:44:20.626191+0000 mgr.y (mgr.14138) 291 : cluster [DBG] pgmap v240: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:21.558 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313258 got 90194313265 for osd.2 2024-02-22T18:44:21.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-22T18:44:21.688 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:21.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:21 smithi040 bash[13988]: audit 2024-02-22T18:44:20.781268+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.40:0/1476778916' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-22T18:44:21.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:21 smithi040 bash[17964]: audit 2024-02-22T18:44:20.781268+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.40:0/1476778916' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-22T18:44:21.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:21 smithi111 bash[14162]: audit 2024-02-22T18:44:20.781268+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.40:0/1476778916' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-22T18:44:22.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:22 smithi040 bash[13988]: cluster 2024-02-22T18:44:22.626679+0000 mgr.y (mgr.14138) 292 : cluster [DBG] pgmap v241: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-22T18:44:22.913 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:22 smithi040 bash[17964]: cluster 2024-02-22T18:44:22.626679+0000 mgr.y (mgr.14138) 292 : cluster [DBG] pgmap v241: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-22T18:44:22.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:22 smithi111 bash[14162]: cluster 2024-02-22T18:44:22.626679+0000 mgr.y (mgr.14138) 292 : cluster [DBG] pgmap v241: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-22T18:44:24.614 INFO:teuthology.orchestra.run.smithi040.stdout:111669149740 2024-02-22T18:44:24.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:24 smithi040 bash[13988]: audit 2024-02-22T18:44:24.610664+0000 mon.a (mon.0) 618 : audit [DBG] from='client.? 172.21.15.40:0/3005267773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-22T18:44:24.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:24 smithi040 bash[13988]: cluster 2024-02-22T18:44:24.627084+0000 mgr.y (mgr.14138) 293 : cluster [DBG] pgmap v242: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-22T18:44:24.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:24 smithi040 bash[17964]: audit 2024-02-22T18:44:24.610664+0000 mon.a (mon.0) 618 : audit [DBG] from='client.? 172.21.15.40:0/3005267773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-22T18:44:24.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:24 smithi040 bash[17964]: cluster 2024-02-22T18:44:24.627084+0000 mgr.y (mgr.14138) 293 : cluster [DBG] pgmap v242: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-22T18:44:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:24 smithi111 bash[14162]: audit 2024-02-22T18:44:24.610664+0000 mon.a (mon.0) 618 : audit [DBG] from='client.? 172.21.15.40:0/3005267773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-22T18:44:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:24 smithi111 bash[14162]: cluster 2024-02-22T18:44:24.627084+0000 mgr.y (mgr.14138) 293 : cluster [DBG] pgmap v242: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-22T18:44:25.372 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149734 got 111669149740 for osd.3 2024-02-22T18:44:25.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-22T18:44:25.502 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:27.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:27 smithi040 bash[13988]: cluster 2024-02-22T18:44:26.627648+0000 mgr.y (mgr.14138) 294 : cluster [DBG] pgmap v243: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:27.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:27 smithi040 bash[17964]: cluster 2024-02-22T18:44:26.627648+0000 mgr.y (mgr.14138) 294 : cluster [DBG] pgmap v243: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:27.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:27 smithi111 bash[14162]: cluster 2024-02-22T18:44:26.627648+0000 mgr.y (mgr.14138) 294 : cluster [DBG] pgmap v243: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:133143986216 2024-02-22T18:44:28.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:28 smithi040 bash[13988]: audit 2024-02-22T18:44:28.386928+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.40:0/4111766097' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-22T18:44:28.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:28 smithi040 bash[17964]: audit 2024-02-22T18:44:28.386928+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.40:0/4111766097' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-22T18:44:28.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:28 smithi111 bash[14162]: audit 2024-02-22T18:44:28.386928+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.40:0/4111766097' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-22T18:44:29.139 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986211 got 133143986216 for osd.4 2024-02-22T18:44:29.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-22T18:44:29.275 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:29.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:29 smithi040 bash[13988]: cluster 2024-02-22T18:44:28.628129+0000 mgr.y (mgr.14138) 295 : cluster [DBG] pgmap v244: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:29.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:29 smithi040 bash[17964]: cluster 2024-02-22T18:44:28.628129+0000 mgr.y (mgr.14138) 295 : cluster [DBG] pgmap v244: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:29.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:29 smithi111 bash[14162]: cluster 2024-02-22T18:44:28.628129+0000 mgr.y (mgr.14138) 295 : cluster [DBG] pgmap v244: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:31.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:31 smithi040 bash[13988]: cluster 2024-02-22T18:44:30.628700+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v245: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:31.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:31 smithi040 bash[17964]: cluster 2024-02-22T18:44:30.628700+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v245: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:31.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:31 smithi111 bash[14162]: cluster 2024-02-22T18:44:30.628700+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v245: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:154618822692 2024-02-22T18:44:32.830 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822687 got 154618822692 for osd.5 2024-02-22T18:44:32.830 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-22T18:44:32.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:32 smithi040 bash[13988]: audit 2024-02-22T18:44:32.049133+0000 mon.a (mon.0) 619 : audit [DBG] from='client.? 172.21.15.40:0/24192637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-22T18:44:32.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:32 smithi040 bash[17964]: audit 2024-02-22T18:44:32.049133+0000 mon.a (mon.0) 619 : audit [DBG] from='client.? 172.21.15.40:0/24192637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-22T18:44:32.964 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:32.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:32 smithi111 bash[14162]: audit 2024-02-22T18:44:32.049133+0000 mon.a (mon.0) 619 : audit [DBG] from='client.? 172.21.15.40:0/24192637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-22T18:44:33.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:33 smithi040 bash[17964]: cluster 2024-02-22T18:44:32.629288+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v246: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:33.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:33 smithi040 bash[13988]: cluster 2024-02-22T18:44:32.629288+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v246: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:33.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:33 smithi111 bash[14162]: cluster 2024-02-22T18:44:32.629288+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v246: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:34.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:34 smithi111 bash[14162]: cluster 2024-02-22T18:44:34.629912+0000 mgr.y (mgr.14138) 298 : cluster [DBG] pgmap v247: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:35.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:34 smithi040 bash[13988]: cluster 2024-02-22T18:44:34.629912+0000 mgr.y (mgr.14138) 298 : cluster [DBG] pgmap v247: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:35.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:34 smithi040 bash[17964]: cluster 2024-02-22T18:44:34.629912+0000 mgr.y (mgr.14138) 298 : cluster [DBG] pgmap v247: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:35.964 INFO:teuthology.orchestra.run.smithi040.stdout:176093659169 2024-02-22T18:44:36.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:36 smithi040 bash[13988]: audit 2024-02-22T18:44:35.960580+0000 mon.a (mon.0) 620 : audit [DBG] from='client.? 172.21.15.40:0/3002461305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-22T18:44:36.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:36 smithi040 bash[17964]: audit 2024-02-22T18:44:35.960580+0000 mon.a (mon.0) 620 : audit [DBG] from='client.? 172.21.15.40:0/3002461305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-22T18:44:36.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:36 smithi111 bash[14162]: audit 2024-02-22T18:44:35.960580+0000 mon.a (mon.0) 620 : audit [DBG] from='client.? 172.21.15.40:0/3002461305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-22T18:44:36.768 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659163 got 176093659169 for osd.6 2024-02-22T18:44:36.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-22T18:44:36.905 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:37.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:37 smithi040 bash[13988]: cluster 2024-02-22T18:44:36.630433+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v248: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:37.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:37 smithi040 bash[17964]: cluster 2024-02-22T18:44:36.630433+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v248: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:37.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:37 smithi111 bash[14162]: cluster 2024-02-22T18:44:36.630433+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v248: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:38.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:38 smithi111 bash[14162]: cluster 2024-02-22T18:44:38.630919+0000 mgr.y (mgr.14138) 300 : cluster [DBG] pgmap v249: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:38 smithi040 bash[13988]: cluster 2024-02-22T18:44:38.630919+0000 mgr.y (mgr.14138) 300 : cluster [DBG] pgmap v249: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:39.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:38 smithi040 bash[17964]: cluster 2024-02-22T18:44:38.630919+0000 mgr.y (mgr.14138) 300 : cluster [DBG] pgmap v249: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:39.936 INFO:teuthology.orchestra.run.smithi040.stdout:197568495645 2024-02-22T18:44:40.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:39 smithi040 bash[13988]: audit 2024-02-22T18:44:39.932219+0000 mon.a (mon.0) 621 : audit [DBG] from='client.? 172.21.15.40:0/3652586661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-22T18:44:40.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:40 smithi040 bash[17964]: audit 2024-02-22T18:44:39.932219+0000 mon.a (mon.0) 621 : audit [DBG] from='client.? 172.21.15.40:0/3652586661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-22T18:44:40.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:39 smithi111 bash[14162]: audit 2024-02-22T18:44:39.932219+0000 mon.a (mon.0) 621 : audit [DBG] from='client.? 172.21.15.40:0/3652586661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-22T18:44:40.724 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495639 got 197568495645 for osd.7 2024-02-22T18:44:40.724 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-22T18:44:40.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph pg dump --format=json 2024-02-22T18:44:40.854 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:41.003 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:40 smithi040 bash[13988]: cluster 2024-02-22T18:44:40.631475+0000 mgr.y (mgr.14138) 301 : cluster [DBG] pgmap v250: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:41.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:40 smithi040 bash[17964]: cluster 2024-02-22T18:44:40.631475+0000 mgr.y (mgr.14138) 301 : cluster [DBG] pgmap v250: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:41.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:41 smithi111 bash[14162]: cluster 2024-02-22T18:44:40.631475+0000 mgr.y (mgr.14138) 301 : cluster [DBG] pgmap v250: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:42.968 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:42 smithi111 bash[14162]: cluster 2024-02-22T18:44:42.632150+0000 mgr.y (mgr.14138) 302 : cluster [DBG] pgmap v251: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:43.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:42 smithi040 bash[13988]: cluster 2024-02-22T18:44:42.632150+0000 mgr.y (mgr.14138) 302 : cluster [DBG] pgmap v251: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:43.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:42 smithi040 bash[17964]: cluster 2024-02-22T18:44:42.632150+0000 mgr.y (mgr.14138) 302 : cluster [DBG] pgmap v251: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:43.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:43 smithi040 bash[13988]: audit 2024-02-22T18:44:42.750461+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:44:43.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:43 smithi040 bash[13988]: audit 2024-02-22T18:44:42.765686+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:44:43.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:43 smithi040 bash[17964]: audit 2024-02-22T18:44:42.750461+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:44:43.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:43 smithi040 bash[17964]: audit 2024-02-22T18:44:42.765686+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:44:43.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:44:43.936 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-02-22T18:44:43.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:43 smithi111 bash[14162]: audit 2024-02-22T18:44:42.750461+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:44:43.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:43 smithi111 bash[14162]: audit 2024-02-22T18:44:42.765686+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:44:44.690 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-02-22T18:44:42.631792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":749961216,"kb_used":8392524,"kb_used_data":3852,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741568692,"statfs":{"total":767960285184,"available":759366340608,"internally_reserved":8589934592,"allocated":3944448,"data_stored":1603863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003400"},"pg_stats":[{"pgid":"2.2","version":"0'0","reported_seq":"11","reported_epoch":"50","state":"active+clean","last_fresh":"2024-02-22T18:42:32.917454+0000","last_change":"2024-02-22T18:42:32.313860+0000","last_active":"2024-02-22T18:42:32.917454+0000","last_peered":"2024-02-22T18:42:32.917454+0000","last_clean":"2024-02-22T18:42:32.917454+0000","last_became_active":"2024-02-22T18:42:32.313200+0000","last_became_peered":"2024-02-22T18:42:32.313200+0000","last_unstale":"2024-02-22T18:42:32.917454+0000","last_undegraded":"2024-02-22T18:42:32.917454+0000","last_fullsized":"2024-02-22T18:42:32.917454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_clean_scrub_stamp":"2024-02-22T18:42:30.876980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"50","state":"active+clean","last_fresh":"2024-02-22T18:42:32.915644+0000","last_change":"2024-02-22T18:42:32.315712+0000","last_active":"2024-02-22T18:42:32.915644+0000","last_peered":"2024-02-22T18:42:32.915644+0000","last_clean":"2024-02-22T18:42:32.915644+0000","last_became_active":"2024-02-22T18:42:32.314337+0000","last_became_peered":"2024-02-22T18:42:32.314337+0000","last_unstale":"2024-02-22T18:42:32.915644+0000","last_undegraded":"2024-02-22T18:42:32.915644+0000","last_fullsized":"2024-02-22T18:42:32.915644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_clean_scrub_stamp":"2024-02-22T18:42:30.876980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"50","state":"active+clean","last_fresh":"2024-02-22T18:42:33.028713+0000","last_change":"2024-02-22T18:42:28.056126+0000","last_active":"2024-02-22T18:42:33.028713+0000","last_peered":"2024-02-22T18:42:33.028713+0000","last_clean":"2024-02-22T18:42:33.028713+0000","last_became_active":"2024-02-22T18:42:28.054853+0000","last_became_peered":"2024-02-22T18:42:28.054853+0000","last_unstale":"2024-02-22T18:42:33.028713+0000","last_undegraded":"2024-02-22T18:42:33.028713+0000","last_fullsized":"2024-02-22T18:42:33.028713+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T18:38:35.533541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T18:38:35.533541+0000","last_clean_scrub_stamp":"2024-02-22T18:38:35.533541+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"51'5","reported_seq":"133","reported_epoch":"51","state":"active+clean","last_fresh":"2024-02-22T18:44:36.456572+0000","last_change":"2024-02-22T18:42:32.314698+0000","last_active":"2024-02-22T18:44:36.456572+0000","last_peered":"2024-02-22T18:44:36.456572+0000","last_clean":"2024-02-22T18:44:36.456572+0000","last_became_active":"2024-02-22T18:42:32.314294+0000","last_became_peered":"2024-02-22T18:42:32.314294+0000","last_unstale":"2024-02-22T18:44:36.456572+0000","last_undegraded":"2024-02-22T18:44:36.456572+0000","last_fullsized":"2024-02-22T18:44:36.456572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_clean_scrub_stamp":"2024-02-22T18:42:30.876980+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495645,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049068,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696084,"statfs":{"total":95995035648,"available":94920790016,"internally_reserved":1073741824,"allocated":495616,"data_stored":200726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84699999999999998,"15min":0.86099999999999999},"min":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.92300000000000004,"15min":0.93400000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.264,"5min":1.395,"15min":1.395},"last":1.244}]},{"osd":1,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89100000000000001,"15min":0.89600000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2450000000000001,"5min":1.333,"15min":1.333},"last":1.169},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.109,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.88900000000000001}]},{"osd":2,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91400000000000003,"15min":0.92000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.161,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":0.92400000000000004},"min":{"1min":0.67500000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.198,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91500000000000004,"15min":0.92200000000000004},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1779999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":1.0169999999999999,"15min":1.0389999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1890000000000001,"5min":1.748,"15min":1.748},"last":1.0309999999999999}]},{"osd":4,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90100000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.256,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.92000000000000004,"15min":0.93300000000000005},"min":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.125,"5min":1.258,"15min":1.258},"last":1.093}]},{"osd":5,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2250000000000001,"5min":1.504,"15min":1.504},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0329999999999999,"15min":1.0389999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3420000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.1399999999999999}]},{"osd":6,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.048,"15min":1.052},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.554,"5min":1.96,"15min":1.96},"last":1.194},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.034,"15min":1.0449999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.216,"5min":1.927,"15min":1.927},"last":1.002}]}]},{"osd":6,"up_from":41,"seq":176093659171,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2150000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.90400000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0600000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.04}]},{"osd":1,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.95899999999999996},"min":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2450000000000001,"5min":1.248,"15min":1.248},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.127,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89700000000000002,"15min":0.88500000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.92600000000000005,"15min":0.93400000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.046,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.97499999999999998}]},{"osd":3,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.75800000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.1339999999999999,"5min":1.538,"15min":1.538},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95299999999999996,"15min":0.95699999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2529999999999999,"5min":1.403,"15min":1.403},"last":0.95199999999999996}]},{"osd":4,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84699999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.093,"5min":1.171,"15min":1.171},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.179,"5min":1.611,"15min":1.611},"last":1.0920000000000001}]},{"osd":5,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.95299999999999996,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1890000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0249999999999999,"15min":1.02},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2350000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Feb 22 18:44:38 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.96199999999999997,"15min":0.95299999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.028,"15min":1.0149999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.0589999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476793,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049068,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696084,"statfs":{"total":95995035648,"available":94920790016,"internally_reserved":1073741824,"allocated":495616,"data_stored":200726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:17 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.67100000000000004,"15min":0.56499999999999995},"min":{"1min":0.46999999999999997,"5min":0.375,"15min":0.375},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.103,"5min":0.745,"15min":0.61299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.7969999999999997,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Feb 22 18:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.68899999999999995},"min":{"1min":0.56599999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3069999999999999,"5min":5.1070000000000002,"15min":5.1070000000000002},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.71299999999999997},"min":{"1min":0.52200000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.163,"5min":6.2530000000000001,"15min":6.2530000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 22 18:44:07 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":0.96599999999999997,"15min":0.89800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.872,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.8159999999999998,"5min":4.8159999999999998,"15min":4.8159999999999998},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Feb 22 18:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.0429999999999999,"15min":0.98099999999999998},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":5.8940000000000001,"5min":5.8940000000000001,"15min":5.8940000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.198,"5min":0.99199999999999999,"15min":0.94999999999999996},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":1.29}]},{"osd":5,"last update":"Thu Feb 22 18:43:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.024,"15min":0.998},"min":{"1min":0.79700000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":4.5869999999999997,"5min":4.5869999999999997,"15min":4.5869999999999997},"last":1.379},{"interface":"front","average":{"1min":1.323,"5min":1.069,"15min":1.0269999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Feb 22 18:44:07 2024","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.1870000000000001,"15min":1.143},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":6.0620000000000003,"5min":6.0620000000000003,"15min":6.0620000000000003},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":4.7439999999999998,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.448}]},{"osd":7,"last update":"Thu Feb 22 18:44:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2669999999999999,"15min":1.2549999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.3109999999999999,"15min":1.2909999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":5.9550000000000001,"5min":5.9550000000000001,"15min":5.9550000000000001},"last":0.96099999999999997}]}]},{"osd":0,"up_from":10,"seq":42949673022,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049068,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696084,"statfs":{"total":95995035648,"available":94920790016,"internally_reserved":1073741824,"allocated":495616,"data_stored":200726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 22 18:44:17 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.68100000000000005,"15min":0.60699999999999998},"min":{"1min":0.55200000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.82099999999999995,"15min":0.74099999999999999},"min":{"1min":0.73699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.90900000000000003}]},{"osd":2,"last update":"Thu Feb 22 18:44:38 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.73699999999999999,"15min":0.68799999999999994},"min":{"1min":0.56200000000000006,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1359999999999999,"5min":1.236,"15min":1.236},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.78000000000000003,"15min":0.70699999999999996},"min":{"1min":0.61399999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Feb 22 18:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79700000000000004,"15min":0.749},"min":{"1min":0.63400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1739999999999999,"5min":1.331,"15min":1.331},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.81399999999999995,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.93400000000000005}]},{"osd":4,"last update":"Thu Feb 22 18:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.997,"15min":0.96299999999999997},"min":{"1min":0.752,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.085},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.88700000000000001,"15min":0.86699999999999999},"min":{"1min":0.73599999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.0820000000000001,"5min":1.355,"15min":1.355},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Feb 22 18:43:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.095,"15min":1.091},"min":{"1min":0.80200000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.131},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.069,"15min":1.054},"min":{"1min":0.88900000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.3240000000000001}]},{"osd":6,"last update":"Thu Feb 22 18:44:03 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.073,"15min":1.0920000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.21,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.256,"15min":1.276},"min":{"1min":0.90200000000000002,"5min":0.879,"15min":0.879},"max":{"1min":1.4199999999999999,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.4039999999999999}]},{"osd":7,"last update":"Thu Feb 22 18:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.1000000000000001,"15min":1.1080000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.321,"5min":1.397,"15min":1.397},"last":1.159},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2709999999999999,"15min":1.2729999999999999},"min":{"1min":1.0660000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.3500000000000001}]}]},{"osd":2,"up_from":21,"seq":90194313269,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.627},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93300000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.70899999999999996,"15min":0.65700000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2689999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.65600000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Feb 22 18:44:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.81200000000000006,"15min":0.78100000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81299999999999994,"15min":0.79300000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.137,"5min":1.544,"15min":1.544},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Feb 22 18:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.97499999999999998,"15min":0.95899999999999996},"min":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.379,"5min":1.667,"15min":1.667},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.0529999999999999},"min":{"1min":0.71199999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3560000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97299999999999998,"15min":0.96999999999999997},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Feb 22 18:44:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.738,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.876},{"interface":"front","average":{"1min":0.995,"5min":1.071,"15min":1.0840000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.474,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Feb 22 18:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.147,"15min":1.143},"min":{"1min":0.83499999999999996,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5569999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.097,"5min":1.1100000000000001,"15min":1.1120000000000001},"min":{"1min":0.64200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.45,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.048}]}]},{"osd":3,"up_from":26,"seq":111669149744,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:00 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.66900000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82599999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.206},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76300000000000001,"15min":0.747},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Feb 22 18:44:00 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77900000000000003,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.99199999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.502,"5min":0.432,"15min":0.432},"max":{"1min":0.93899999999999995,"5min":2.7330000000000001,"15min":2.7330000000000001},"last":1.3120000000000001}]},{"osd":2,"last update":"Thu Feb 22 18:44:00 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.88,"15min":0.89200000000000002},"min":{"1min":0.57899999999999996,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1259999999999999,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.60499999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.131,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Feb 22 18:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94299999999999995,"15min":0.92500000000000004},"min":{"1min":0.76400000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3520000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.98799999999999999,"15min":0.97499999999999998},"min":{"1min":0.74199999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.319,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Feb 22 18:43:46 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.083,"15min":1.089},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.498,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":1.002},{"interface":"front","average":{"1min":1.056,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.86599999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4410000000000001,"5min":1.486,"15min":1.486},"last":1.113}]},{"osd":6,"last update":"Thu Feb 22 18:44:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.083,"15min":1.079},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.585,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.089,"5min":1.117,"15min":1.1220000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.171}]},{"osd":7,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.171,"15min":1.173},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3120000000000001,"5min":1.419,"15min":1.419},"last":1.29},{"interface":"front","average":{"1min":1.204,"5min":1.1930000000000001,"15min":1.1910000000000001},"min":{"1min":0.95999999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.4239999999999999,"5min":1.524,"15min":1.524},"last":1.1459999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83099999999999996,"15min":0.81000000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82999999999999996,"15min":0.81399999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1339999999999999,"5min":1.157,"15min":1.157},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.82499999999999996,"15min":0.79300000000000004},"min":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85499999999999998,"15min":0.84699999999999998},"min":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.254,"15min":1.254},"last":0.875}]},{"osd":2,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.88800000000000001,"15min":0.85399999999999998},"min":{"1min":0.68400000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.873,"15min":0.84299999999999997},"min":{"1min":0.80200000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.157,"5min":1.294,"15min":1.294},"last":1.143}]},{"osd":5,"last update":"Thu Feb 22 18:43:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.83399999999999996},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.036,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.044}]},{"osd":6,"last update":"Thu Feb 22 18:44:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1890000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.91400000000000003},"min":{"1min":0.59799999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1000000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0780000000000001}]},{"osd":7,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.70699999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.01,"15min":1.004},"min":{"1min":0.65900000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.026}]}]},{"osd":5,"up_from":36,"seq":154618822695,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.90400000000000003,"15min":0.91600000000000004},"min":{"1min":0.60899999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1579999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.877,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0940000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86499999999999999,"15min":0.87},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.032,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.90800000000000003,"15min":0.90400000000000003},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.139,"5min":1.504,"15min":1.504},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0680000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0700000000000001}]},{"osd":3,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.92200000000000004,"15min":0.92800000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1439999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.96099999999999997,"15min":0.96299999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2050000000000001,"5min":1.369,"15min":1.369},"last":1.03}]},{"osd":4,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3660000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Feb 22 18:44:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.94299999999999995,"15min":0.92400000000000004},"min":{"1min":0.79300000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.373,"5min":1.401,"15min":1.401},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.044,"5min":0.93200000000000005,"15min":0.91300000000000003},"min":{"1min":0.70499999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Feb 22 18:44:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.081,"15min":1.0860000000000001},"min":{"1min":0.67900000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0069999999999999}]}]}]}} 2024-02-22T18:44:44.692 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph pg dump --format=json 2024-02-22T18:44:44.823 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:44 smithi040 bash[13988]: audit 2024-02-22T18:44:43.925469+0000 mgr.y (mgr.14138) 303 : audit [DBG] from='client.24541 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T18:44:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:44 smithi040 bash[13988]: cluster 2024-02-22T18:44:44.632712+0000 mgr.y (mgr.14138) 304 : cluster [DBG] pgmap v252: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:45.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:44 smithi040 bash[17964]: audit 2024-02-22T18:44:43.925469+0000 mgr.y (mgr.14138) 303 : audit [DBG] from='client.24541 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T18:44:45.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:44 smithi040 bash[17964]: cluster 2024-02-22T18:44:44.632712+0000 mgr.y (mgr.14138) 304 : cluster [DBG] pgmap v252: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:45.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:44 smithi111 bash[14162]: audit 2024-02-22T18:44:43.925469+0000 mgr.y (mgr.14138) 303 : audit [DBG] from='client.24541 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T18:44:45.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:44 smithi111 bash[14162]: cluster 2024-02-22T18:44:44.632712+0000 mgr.y (mgr.14138) 304 : cluster [DBG] pgmap v252: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:47.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:47 smithi040 bash[17964]: cluster 2024-02-22T18:44:46.633248+0000 mgr.y (mgr.14138) 305 : cluster [DBG] pgmap v253: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:47.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:47 smithi040 bash[13988]: cluster 2024-02-22T18:44:46.633248+0000 mgr.y (mgr.14138) 305 : cluster [DBG] pgmap v253: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:47.751 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:44:47.751 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-02-22T18:44:47.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:47 smithi111 bash[14162]: cluster 2024-02-22T18:44:46.633248+0000 mgr.y (mgr.14138) 305 : cluster [DBG] pgmap v253: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:48.474 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-02-22T18:44:46.633000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":749961216,"kb_used":8392524,"kb_used_data":3852,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741568692,"statfs":{"total":767960285184,"available":759366340608,"internally_reserved":8589934592,"allocated":3944448,"data_stored":1603863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003407"},"pg_stats":[{"pgid":"2.2","version":"0'0","reported_seq":"11","reported_epoch":"50","state":"active+clean","last_fresh":"2024-02-22T18:42:32.917454+0000","last_change":"2024-02-22T18:42:32.313860+0000","last_active":"2024-02-22T18:42:32.917454+0000","last_peered":"2024-02-22T18:42:32.917454+0000","last_clean":"2024-02-22T18:42:32.917454+0000","last_became_active":"2024-02-22T18:42:32.313200+0000","last_became_peered":"2024-02-22T18:42:32.313200+0000","last_unstale":"2024-02-22T18:42:32.917454+0000","last_undegraded":"2024-02-22T18:42:32.917454+0000","last_fullsized":"2024-02-22T18:42:32.917454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_clean_scrub_stamp":"2024-02-22T18:42:30.876980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"11","reported_epoch":"50","state":"active+clean","last_fresh":"2024-02-22T18:42:32.915644+0000","last_change":"2024-02-22T18:42:32.315712+0000","last_active":"2024-02-22T18:42:32.915644+0000","last_peered":"2024-02-22T18:42:32.915644+0000","last_clean":"2024-02-22T18:42:32.915644+0000","last_became_active":"2024-02-22T18:42:32.314337+0000","last_became_peered":"2024-02-22T18:42:32.314337+0000","last_unstale":"2024-02-22T18:42:32.915644+0000","last_undegraded":"2024-02-22T18:42:32.915644+0000","last_fullsized":"2024-02-22T18:42:32.915644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_clean_scrub_stamp":"2024-02-22T18:42:30.876980+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"50","state":"active+clean","last_fresh":"2024-02-22T18:42:33.028713+0000","last_change":"2024-02-22T18:42:28.056126+0000","last_active":"2024-02-22T18:42:33.028713+0000","last_peered":"2024-02-22T18:42:33.028713+0000","last_clean":"2024-02-22T18:42:33.028713+0000","last_became_active":"2024-02-22T18:42:28.054853+0000","last_became_peered":"2024-02-22T18:42:28.054853+0000","last_unstale":"2024-02-22T18:42:33.028713+0000","last_undegraded":"2024-02-22T18:42:33.028713+0000","last_fullsized":"2024-02-22T18:42:33.028713+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T18:38:35.533541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T18:38:35.533541+0000","last_clean_scrub_stamp":"2024-02-22T18:38:35.533541+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"51'5","reported_seq":"138","reported_epoch":"51","state":"active+clean","last_fresh":"2024-02-22T18:44:41.466437+0000","last_change":"2024-02-22T18:42:32.314698+0000","last_active":"2024-02-22T18:44:41.466437+0000","last_peered":"2024-02-22T18:44:41.466437+0000","last_clean":"2024-02-22T18:44:41.466437+0000","last_became_active":"2024-02-22T18:42:32.314294+0000","last_became_peered":"2024-02-22T18:42:32.314294+0000","last_unstale":"2024-02-22T18:44:41.466437+0000","last_undegraded":"2024-02-22T18:44:41.466437+0000","last_fullsized":"2024-02-22T18:44:41.466437+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T18:42:30.876980+0000","last_clean_scrub_stamp":"2024-02-22T18:42:30.876980+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495646,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049068,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696084,"statfs":{"total":95995035648,"available":94920790016,"internally_reserved":1073741824,"allocated":495616,"data_stored":200726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.84699999999999998,"15min":0.86099999999999999},"min":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.92300000000000004,"15min":0.93400000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.264,"5min":1.395,"15min":1.395},"last":1.0329999999999999}]},{"osd":1,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89100000000000001,"15min":0.89600000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2450000000000001,"5min":1.333,"15min":1.333},"last":1.141},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.109,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91400000000000003,"15min":0.92000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.161,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.92300000000000004,"15min":0.92400000000000004},"min":{"1min":0.67500000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.198,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91500000000000004,"15min":0.92200000000000004},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1779999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":1.0169999999999999,"15min":1.0389999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1890000000000001,"5min":1.748,"15min":1.748},"last":1.1000000000000001}]},{"osd":4,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90100000000000002,"15min":0.90000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.256,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.92000000000000004,"15min":0.93300000000000005},"min":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.125,"5min":1.258,"15min":1.258},"last":0.97899999999999998}]},{"osd":5,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2250000000000001,"5min":1.504,"15min":1.504},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0329999999999999,"15min":1.0389999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3420000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.048,"15min":1.052},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.554,"5min":1.96,"15min":1.96},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.034,"15min":1.0449999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.216,"5min":1.927,"15min":1.927},"last":1.0700000000000001}]}]},{"osd":6,"up_from":41,"seq":176093659171,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2150000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.90400000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0600000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.04}]},{"osd":1,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.95899999999999996},"min":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2450000000000001,"5min":1.248,"15min":1.248},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.127,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89700000000000002,"15min":0.88500000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.92600000000000005,"15min":0.93400000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.046,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.97499999999999998}]},{"osd":3,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.75800000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.1339999999999999,"5min":1.538,"15min":1.538},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95299999999999996,"15min":0.95699999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2529999999999999,"5min":1.403,"15min":1.403},"last":0.95199999999999996}]},{"osd":4,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84699999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.093,"5min":1.171,"15min":1.171},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.179,"5min":1.611,"15min":1.611},"last":1.0920000000000001}]},{"osd":5,"last update":"Thu Feb 22 18:44:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.95299999999999996,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1890000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0249999999999999,"15min":1.02},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2350000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Feb 22 18:44:38 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.96199999999999997,"15min":0.95299999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.028,"15min":1.0149999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.0589999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476793,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049068,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696084,"statfs":{"total":95995035648,"available":94920790016,"internally_reserved":1073741824,"allocated":495616,"data_stored":200726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:17 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.67100000000000004,"15min":0.56499999999999995},"min":{"1min":0.46999999999999997,"5min":0.375,"15min":0.375},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.103,"5min":0.745,"15min":0.61299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.7969999999999997,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Feb 22 18:44:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.68899999999999995},"min":{"1min":0.56599999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3069999999999999,"5min":5.1070000000000002,"15min":5.1070000000000002},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.71299999999999997},"min":{"1min":0.52200000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.163,"5min":6.2530000000000001,"15min":6.2530000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 22 18:44:07 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":0.96599999999999997,"15min":0.89800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":6.0099999999999998,"5min":6.0099999999999998,"15min":6.0099999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.872,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.8159999999999998,"5min":4.8159999999999998,"15min":4.8159999999999998},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Feb 22 18:44:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.0429999999999999,"15min":0.98099999999999998},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":5.8940000000000001,"5min":5.8940000000000001,"15min":5.8940000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.198,"5min":0.99199999999999999,"15min":0.94999999999999996},"min":{"1min":0.69299999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":1.29}]},{"osd":5,"last update":"Thu Feb 22 18:43:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.024,"15min":0.998},"min":{"1min":0.79700000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":4.5869999999999997,"5min":4.5869999999999997,"15min":4.5869999999999997},"last":1.379},{"interface":"front","average":{"1min":1.323,"5min":1.069,"15min":1.0269999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":4.9829999999999997,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Feb 22 18:44:07 2024","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.1870000000000001,"15min":1.143},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":6.0620000000000003,"5min":6.0620000000000003,"15min":6.0620000000000003},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":4.7439999999999998,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.448}]},{"osd":7,"last update":"Thu Feb 22 18:44:35 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.2669999999999999,"15min":1.2549999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.3109999999999999,"15min":1.2909999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":5.9550000000000001,"5min":5.9550000000000001,"15min":5.9550000000000001},"last":0.96099999999999997}]}]},{"osd":0,"up_from":10,"seq":42949673023,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049068,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696084,"statfs":{"total":95995035648,"available":94920790016,"internally_reserved":1073741824,"allocated":495616,"data_stored":200726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 22 18:44:17 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.68100000000000005,"15min":0.60699999999999998},"min":{"1min":0.55200000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.82099999999999995,"15min":0.74099999999999999},"min":{"1min":0.73699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Feb 22 18:44:38 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.73699999999999999,"15min":0.68799999999999994},"min":{"1min":0.56200000000000006,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1359999999999999,"5min":1.236,"15min":1.236},"last":0.625},{"interface":"front","average":{"1min":0.871,"5min":0.78000000000000003,"15min":0.70699999999999996},"min":{"1min":0.61399999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Feb 22 18:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79700000000000004,"15min":0.749},"min":{"1min":0.63400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1739999999999999,"5min":1.331,"15min":1.331},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.81399999999999995,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Feb 22 18:44:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.997,"15min":0.96299999999999997},"min":{"1min":0.752,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.88700000000000001,"15min":0.86699999999999999},"min":{"1min":0.73599999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.0820000000000001,"5min":1.355,"15min":1.355},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Feb 22 18:44:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.081,"15min":1.0860000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3700000000000001,"5min":1.544,"15min":1.544},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.083,"15min":1.0589999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Feb 22 18:44:03 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.073,"15min":1.0920000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.21,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.137,"5min":1.256,"15min":1.276},"min":{"1min":0.90200000000000002,"5min":0.879,"15min":0.879},"max":{"1min":1.4199999999999999,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.02}]},{"osd":7,"last update":"Thu Feb 22 18:44:31 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.1000000000000001,"15min":1.1080000000000001},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.321,"5min":1.397,"15min":1.397},"last":1.111},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2709999999999999,"15min":1.2729999999999999},"min":{"1min":1.0660000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.93899999999999995}]}]},{"osd":2,"up_from":21,"seq":90194313270,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.627},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93300000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.70899999999999996,"15min":0.65700000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2689999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.65600000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Feb 22 18:44:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.81200000000000006,"15min":0.78100000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.129},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81299999999999994,"15min":0.79300000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.137,"5min":1.544,"15min":1.544},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Feb 22 18:44:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.97499999999999998,"15min":0.95899999999999996},"min":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.379,"5min":1.667,"15min":1.667},"last":0.997},{"interface":"front","average":{"1min":1.004,"5min":1.0680000000000001,"15min":1.0529999999999999},"min":{"1min":0.71199999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3560000000000001,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.4730000000000001}]},{"osd":5,"last update":"Thu Feb 22 18:43:41 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1040000000000001,"15min":1.1000000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.5740000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97299999999999998,"15min":0.96999999999999997},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Feb 22 18:44:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.738,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":0.995,"5min":1.071,"15min":1.0840000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.474,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.089}]},{"osd":7,"last update":"Thu Feb 22 18:44:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.147,"15min":1.143},"min":{"1min":0.83499999999999996,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5569999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.1100000000000001,"15min":1.1120000000000001},"min":{"1min":0.64200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.45,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2170000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149744,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:00 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.66900000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82599999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.206},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76300000000000001,"15min":0.747},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Feb 22 18:44:00 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77900000000000003,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.99199999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.502,"5min":0.432,"15min":0.432},"max":{"1min":0.93899999999999995,"5min":2.7330000000000001,"15min":2.7330000000000001},"last":1.3120000000000001}]},{"osd":2,"last update":"Thu Feb 22 18:44:00 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.88,"15min":0.89200000000000002},"min":{"1min":0.57899999999999996,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1259999999999999,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.60499999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.131,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Feb 22 18:44:19 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.94299999999999995,"15min":0.92500000000000004},"min":{"1min":0.76400000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.3520000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.98799999999999999,"15min":0.97499999999999998},"min":{"1min":0.74199999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.319,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Feb 22 18:43:46 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.083,"15min":1.089},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.498,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":1.002},{"interface":"front","average":{"1min":1.056,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.86599999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4410000000000001,"5min":1.486,"15min":1.486},"last":1.113}]},{"osd":6,"last update":"Thu Feb 22 18:44:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.083,"15min":1.079},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.585,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.089,"5min":1.117,"15min":1.1220000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.171}]},{"osd":7,"last update":"Thu Feb 22 18:44:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.171,"15min":1.173},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3120000000000001,"5min":1.419,"15min":1.419},"last":1.29},{"interface":"front","average":{"1min":1.204,"5min":1.1930000000000001,"15min":1.1910000000000001},"min":{"1min":0.95999999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.4239999999999999,"5min":1.524,"15min":1.524},"last":1.1459999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83099999999999996,"15min":0.81000000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82999999999999996,"15min":0.81399999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1339999999999999,"5min":1.157,"15min":1.157},"last":0.97699999999999998}]},{"osd":1,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.82499999999999996,"15min":0.79300000000000004},"min":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85499999999999998,"15min":0.84699999999999998},"min":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.254,"15min":1.254},"last":0.93799999999999994}]},{"osd":2,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.88800000000000001,"15min":0.85399999999999998},"min":{"1min":0.68400000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.873,"15min":0.84299999999999997},"min":{"1min":0.80200000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.157,"5min":1.294,"15min":1.294},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Feb 22 18:43:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.83399999999999996},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.036,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Feb 22 18:44:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1890000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.91400000000000003},"min":{"1min":0.59799999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1000000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Feb 22 18:44:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.70699999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.01,"15min":1.004},"min":{"1min":0.65900000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.89200000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822696,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049064,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696088,"statfs":{"total":95995035648,"available":94920794112,"internally_reserved":1073741824,"allocated":491520,"data_stored":200337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 18:44:42 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.89400000000000002,"15min":0.91200000000000003},"min":{"1min":0.56999999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.242,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.876,"15min":0.88200000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.25,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Feb 22 18:44:42 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86099999999999999,"15min":0.86899999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1060000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92000000000000004,"15min":0.90800000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Thu Feb 22 18:44:42 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.157,"5min":1.504,"15min":1.504},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91100000000000003,"15min":0.91300000000000003},"min":{"1min":0.73099999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.121,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Feb 22 18:44:42 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.90700000000000003,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1830000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95699999999999996,"15min":0.96199999999999997},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2909999999999999,"5min":1.369,"15min":1.369},"last":0.95499999999999996}]},{"osd":4,"last update":"Thu Feb 22 18:44:42 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.84799999999999998,"15min":0.83499999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94399999999999995,"15min":0.93600000000000005},"min":{"1min":0.59499999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3200000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Feb 22 18:44:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.94299999999999995,"15min":0.92400000000000004},"min":{"1min":0.79300000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.373,"5min":1.401,"15min":1.401},"last":1.121},{"interface":"front","average":{"1min":1.044,"5min":0.93200000000000005,"15min":0.91300000000000003},"min":{"1min":0.70499999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.876}]},{"osd":7,"last update":"Thu Feb 22 18:44:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.081,"15min":1.0860000000000001},"min":{"1min":0.67900000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.016},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.079}]}]}]}} 2024-02-22T18:44:48.475 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-22T18:44:48.475 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-22T18:44:48.475 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-22T18:44:48.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- ceph health --format=json 2024-02-22T18:44:48.608 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.a/config 2024-02-22T18:44:48.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:48 smithi040 bash[17964]: audit 2024-02-22T18:44:47.736509+0000 mgr.y (mgr.14138) 306 : audit [DBG] from='client.34544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T18:44:48.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:48 smithi040 bash[17964]: cluster 2024-02-22T18:44:48.633827+0000 mgr.y (mgr.14138) 307 : cluster [DBG] pgmap v254: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:48.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:48 smithi040 bash[13988]: audit 2024-02-22T18:44:47.736509+0000 mgr.y (mgr.14138) 306 : audit [DBG] from='client.34544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T18:44:48.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:48 smithi040 bash[13988]: cluster 2024-02-22T18:44:48.633827+0000 mgr.y (mgr.14138) 307 : cluster [DBG] pgmap v254: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:48.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:48 smithi111 bash[14162]: audit 2024-02-22T18:44:47.736509+0000 mgr.y (mgr.14138) 306 : audit [DBG] from='client.34544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T18:44:48.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:48 smithi111 bash[14162]: cluster 2024-02-22T18:44:48.633827+0000 mgr.y (mgr.14138) 307 : cluster [DBG] pgmap v254: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:50.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:50 smithi111 bash[14162]: cluster 2024-02-22T18:44:50.634482+0000 mgr.y (mgr.14138) 308 : cluster [DBG] pgmap v255: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:51.174 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:50 smithi040 bash[13988]: cluster 2024-02-22T18:44:50.634482+0000 mgr.y (mgr.14138) 308 : cluster [DBG] pgmap v255: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:51.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:50 smithi040 bash[17964]: cluster 2024-02-22T18:44:50.634482+0000 mgr.y (mgr.14138) 308 : cluster [DBG] pgmap v255: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:44:51.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:51 smithi040 bash[13988]: audit 2024-02-22T18:44:51.556310+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.40:0/3437360793' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T18:44:51.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:51 smithi040 bash[17964]: audit 2024-02-22T18:44:51.556310+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.40:0/3437360793' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T18:44:51.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:51 smithi111 bash[14162]: audit 2024-02-22T18:44:51.556310+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.40:0/3437360793' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T18:44:52.265 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-22T18:44:52.266 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-22T18:44:52.266 INFO:tasks.cephadm:Setup complete, yielding 2024-02-22T18:44:52.266 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T18:44:52.275 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-02-22T18:44:52.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2024-02-22T18:44:53.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:52 smithi040 bash[13988]: cluster 2024-02-22T18:44:52.635283+0000 mgr.y (mgr.14138) 309 : cluster [DBG] pgmap v256: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:53.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:52 smithi040 bash[17964]: cluster 2024-02-22T18:44:52.635283+0000 mgr.y (mgr.14138) 309 : cluster [DBG] pgmap v256: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:53.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:52 smithi111 bash[14162]: cluster 2024-02-22T18:44:52.635283+0000 mgr.y (mgr.14138) 309 : cluster [DBG] pgmap v256: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:54.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:54 smithi111 bash[14162]: cluster 2024-02-22T18:44:54.635869+0000 mgr.y (mgr.14138) 310 : cluster [DBG] pgmap v257: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:54.991 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:54 smithi040 bash[13988]: cluster 2024-02-22T18:44:54.635869+0000 mgr.y (mgr.14138) 310 : cluster [DBG] pgmap v257: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:54.991 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:54 smithi040 bash[17964]: cluster 2024-02-22T18:44:54.635869+0000 mgr.y (mgr.14138) 310 : cluster [DBG] pgmap v257: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:56.040 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T18:44:56.049 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-02-22T18:44:56.049 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-02-22T18:44:56.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:56 smithi040 bash[13988]: audit 2024-02-22T18:44:55.286850+0000 mon.a (mon.0) 624 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:44:56.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:56 smithi040 bash[13988]: cephadm 2024-02-22T18:44:55.293612+0000 mgr.y (mgr.14138) 311 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:44:56.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:56 smithi040 bash[13988]: audit 2024-02-22T18:44:55.644644+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:56 smithi040 bash[17964]: audit 2024-02-22T18:44:55.286850+0000 mon.a (mon.0) 624 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:44:56.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:56 smithi040 bash[17964]: cephadm 2024-02-22T18:44:55.293612+0000 mgr.y (mgr.14138) 311 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:44:56.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:56 smithi040 bash[17964]: audit 2024-02-22T18:44:55.644644+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:56.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:56 smithi111 bash[14162]: audit 2024-02-22T18:44:55.286850+0000 mon.a (mon.0) 624 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:44:56.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:56 smithi111 bash[14162]: cephadm 2024-02-22T18:44:55.293612+0000 mgr.y (mgr.14138) 311 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:44:56.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:56 smithi111 bash[14162]: audit 2024-02-22T18:44:55.644644+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:44:57.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:57 smithi040 bash[13988]: cluster 2024-02-22T18:44:56.636443+0000 mgr.y (mgr.14138) 312 : cluster [DBG] pgmap v258: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:57.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:57 smithi040 bash[17964]: cluster 2024-02-22T18:44:56.636443+0000 mgr.y (mgr.14138) 312 : cluster [DBG] pgmap v258: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:57.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:57 smithi111 bash[14162]: cluster 2024-02-22T18:44:56.636443+0000 mgr.y (mgr.14138) 312 : cluster [DBG] pgmap v258: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-22T18:44:58.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:44:58 smithi111 bash[14162]: cluster 2024-02-22T18:44:58.636980+0000 mgr.y (mgr.14138) 313 : cluster [DBG] pgmap v259: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:58.992 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:44:58 smithi040 bash[13988]: cluster 2024-02-22T18:44:58.636980+0000 mgr.y (mgr.14138) 313 : cluster [DBG] pgmap v259: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:44:58.992 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:44:58 smithi040 bash[17964]: cluster 2024-02-22T18:44:58.636980+0000 mgr.y (mgr.14138) 313 : cluster [DBG] pgmap v259: 4 pgs: 4 active+clean; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:45:00.771 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-22T18:45:00.772 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "13206693-ac4b-4b10-9a16-38d32d5262a8", 2024-02-22T18:45:00.772 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "r", 2024-02-22T18:45:00.772 INFO:teuthology.orchestra.run.smithi040.stdout: "current_period": "fe2da510-5c6b-4696-b3af-3192aa23e7b9", 2024-02-22T18:45:00.772 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 1 2024-02-22T18:45:00.772 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-22T18:45:01.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:00 smithi040 bash[17964]: cluster 2024-02-22T18:44:59.718720+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-22T18:45:01.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:00 smithi040 bash[17964]: audit 2024-02-22T18:44:59.723425+0000 mon.a (mon.0) 627 : audit [INF] from='client.? 172.21.15.40:0/535613510' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-22T18:45:01.059 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:00 smithi040 bash[17964]: cluster 2024-02-22T18:45:00.637588+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v261: 36 pgs: 6 creating+peering, 4 active+clean, 26 unknown; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:45:01.059 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:00 smithi040 bash[13988]: cluster 2024-02-22T18:44:59.718720+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-22T18:45:01.059 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:00 smithi040 bash[13988]: audit 2024-02-22T18:44:59.723425+0000 mon.a (mon.0) 627 : audit [INF] from='client.? 172.21.15.40:0/535613510' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-22T18:45:01.060 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:00 smithi040 bash[13988]: cluster 2024-02-22T18:45:00.637588+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v261: 36 pgs: 6 creating+peering, 4 active+clean, 26 unknown; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:45:01.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:00 smithi111 bash[14162]: cluster 2024-02-22T18:44:59.718720+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-22T18:45:01.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:00 smithi111 bash[14162]: audit 2024-02-22T18:44:59.723425+0000 mon.a (mon.0) 627 : audit [INF] from='client.? 172.21.15.40:0/535613510' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-22T18:45:01.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:00 smithi111 bash[14162]: cluster 2024-02-22T18:45:00.637588+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v261: 36 pgs: 6 creating+peering, 4 active+clean, 26 unknown; 389 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:45:01.506 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-02-22T18:45:01.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:01 smithi040 bash[13988]: audit 2024-02-22T18:45:00.724286+0000 mon.a (mon.0) 628 : audit [INF] from='client.? 172.21.15.40:0/535613510' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-22T18:45:01.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:01 smithi040 bash[13988]: cluster 2024-02-22T18:45:00.725741+0000 mon.a (mon.0) 629 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-22T18:45:01.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:01 smithi040 bash[17964]: audit 2024-02-22T18:45:00.724286+0000 mon.a (mon.0) 628 : audit [INF] from='client.? 172.21.15.40:0/535613510' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-22T18:45:01.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:01 smithi040 bash[17964]: cluster 2024-02-22T18:45:00.725741+0000 mon.a (mon.0) 629 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-22T18:45:02.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:01 smithi111 bash[14162]: audit 2024-02-22T18:45:00.724286+0000 mon.a (mon.0) 628 : audit [INF] from='client.? 172.21.15.40:0/535613510' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-22T18:45:02.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:01 smithi111 bash[14162]: cluster 2024-02-22T18:45:00.725741+0000 mon.a (mon.0) 629 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-22T18:45:02.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:02 smithi040 bash[13988]: cluster 2024-02-22T18:45:01.745074+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-22T18:45:02.776 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:02 smithi040 bash[13988]: cluster 2024-02-22T18:45:02.638326+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v264: 36 pgs: 11 creating+peering, 25 active+clean; 616 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 853 B/s wr, 2 op/s 2024-02-22T18:45:03.066 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:02 smithi040 bash[17964]: cluster 2024-02-22T18:45:01.745074+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-22T18:45:03.066 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:02 smithi040 bash[17964]: cluster 2024-02-22T18:45:02.638326+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v264: 36 pgs: 11 creating+peering, 25 active+clean; 616 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 853 B/s wr, 2 op/s 2024-02-22T18:45:03.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:02 smithi111 bash[14162]: cluster 2024-02-22T18:45:01.745074+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-22T18:45:03.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:02 smithi111 bash[14162]: cluster 2024-02-22T18:45:02.638326+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v264: 36 pgs: 11 creating+peering, 25 active+clean; 616 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s rd, 853 B/s wr, 2 op/s 2024-02-22T18:45:04.474 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-22T18:45:04.474 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "5a48f7af-b3b6-4652-adeb-b3df77a84957", 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default", 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "api_name": "default", 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "is_master": "true", 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "endpoints": [], 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "hostnames": [], 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "hostnames_s3website": [], 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "master_zone": "", 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "zones": [], 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "placement_targets": [], 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "default_placement": "", 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_id": "13206693-ac4b-4b10-9a16-38d32d5262a8", 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_policy": { 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: "groups": [] 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:04.475 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-22T18:45:04.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:04 smithi040 bash[13988]: cluster 2024-02-22T18:45:04.639005+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v265: 36 pgs: 11 creating+peering, 25 active+clean; 616 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 1 op/s 2024-02-22T18:45:04.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:04 smithi040 bash[17964]: cluster 2024-02-22T18:45:04.639005+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v265: 36 pgs: 11 creating+peering, 25 active+clean; 616 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 1 op/s 2024-02-22T18:45:04.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:04 smithi111 bash[14162]: cluster 2024-02-22T18:45:04.639005+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v265: 36 pgs: 11 creating+peering, 25 active+clean; 616 B data, 4.0 MiB used, 707 GiB / 715 GiB avail; 853 B/s rd, 853 B/s wr, 1 op/s 2024-02-22T18:45:05.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-02-22T18:45:07.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:07 smithi040 bash[13988]: cluster 2024-02-22T18:45:06.639730+0000 mgr.y (mgr.14138) 317 : cluster [DBG] pgmap v266: 36 pgs: 36 active+clean; 951 B data, 4.1 MiB used, 707 GiB / 715 GiB avail; 887 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-22T18:45:07.911 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:07 smithi040 bash[17964]: cluster 2024-02-22T18:45:06.639730+0000 mgr.y (mgr.14138) 317 : cluster [DBG] pgmap v266: 36 pgs: 36 active+clean; 951 B data, 4.1 MiB used, 707 GiB / 715 GiB avail; 887 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-22T18:45:07.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:07 smithi111 bash[14162]: cluster 2024-02-22T18:45:06.639730+0000 mgr.y (mgr.14138) 317 : cluster [DBG] pgmap v266: 36 pgs: 36 active+clean; 951 B data, 4.1 MiB used, 707 GiB / 715 GiB avail; 887 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-22T18:45:08.031 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-22T18:45:08.031 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "30019451-a0f8-4d5e-bb0d-1fd519518d3c", 2024-02-22T18:45:08.031 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "z", 2024-02-22T18:45:08.031 INFO:teuthology.orchestra.run.smithi040.stdout: "domain_root": "z.rgw.meta:root", 2024-02-22T18:45:08.031 INFO:teuthology.orchestra.run.smithi040.stdout: "control_pool": "z.rgw.control", 2024-02-22T18:45:08.031 INFO:teuthology.orchestra.run.smithi040.stdout: "gc_pool": "z.rgw.log:gc", 2024-02-22T18:45:08.031 INFO:teuthology.orchestra.run.smithi040.stdout: "lc_pool": "z.rgw.log:lc", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "log_pool": "z.rgw.log", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "roles_pool": "z.rgw.meta:roles", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "otp_pool": "z.rgw.otp", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "system_key": { 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "access_key": "", 2024-02-22T18:45:08.032 INFO:teuthology.orchestra.run.smithi040.stdout: "secret_key": "" 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: "placement_pools": [ 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "default-placement", 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: "val": { 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: "index_pool": "z.rgw.buckets.index", 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_classes": { 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: "STANDARD": { 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: "data_pool": "z.rgw.buckets.data" 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: "index_type": 0 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:08.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:08.034 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-22T18:45:08.034 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_id": "13206693-ac4b-4b10-9a16-38d32d5262a8" 2024-02-22T18:45:08.034 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-22T18:45:08.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-02-22T18:45:08.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:08 smithi111 bash[14162]: cluster 2024-02-22T18:45:08.640520+0000 mgr.y (mgr.14138) 318 : cluster [DBG] pgmap v267: 36 pgs: 36 active+clean; 1.1 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-22T18:45:09.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:08 smithi040 bash[13988]: cluster 2024-02-22T18:45:08.640520+0000 mgr.y (mgr.14138) 318 : cluster [DBG] pgmap v267: 36 pgs: 36 active+clean; 1.1 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-22T18:45:09.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:08 smithi040 bash[17964]: cluster 2024-02-22T18:45:08.640520+0000 mgr.y (mgr.14138) 318 : cluster [DBG] pgmap v267: 36 pgs: 36 active+clean; 1.1 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-22T18:45:10.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:10 smithi111 bash[14162]: cluster 2024-02-22T18:45:10.641211+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v268: 36 pgs: 36 active+clean; 1.9 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-22T18:45:11.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:10 smithi040 bash[13988]: cluster 2024-02-22T18:45:10.641211+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v268: 36 pgs: 36 active+clean; 1.9 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-22T18:45:11.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:10 smithi040 bash[17964]: cluster 2024-02-22T18:45:10.641211+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v268: 36 pgs: 36 active+clean; 1.9 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-22T18:45:13.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:12 smithi040 bash[13988]: cluster 2024-02-22T18:45:11.889251+0000 mon.a (mon.0) 631 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-22T18:45:13.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:12 smithi040 bash[13988]: audit 2024-02-22T18:45:11.894040+0000 mon.a (mon.0) 632 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-22T18:45:13.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:12 smithi040 bash[13988]: cluster 2024-02-22T18:45:12.642088+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v270: 68 pgs: 21 creating+peering, 11 unknown, 36 active+clean; 2.2 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-22T18:45:13.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:12 smithi040 bash[17964]: cluster 2024-02-22T18:45:11.889251+0000 mon.a (mon.0) 631 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-22T18:45:13.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:12 smithi040 bash[17964]: audit 2024-02-22T18:45:11.894040+0000 mon.a (mon.0) 632 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-22T18:45:13.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:12 smithi040 bash[17964]: cluster 2024-02-22T18:45:12.642088+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v270: 68 pgs: 21 creating+peering, 11 unknown, 36 active+clean; 2.2 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-22T18:45:13.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:12 smithi111 bash[14162]: cluster 2024-02-22T18:45:11.889251+0000 mon.a (mon.0) 631 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-22T18:45:13.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:12 smithi111 bash[14162]: audit 2024-02-22T18:45:11.894040+0000 mon.a (mon.0) 632 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-22T18:45:13.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:12 smithi111 bash[14162]: cluster 2024-02-22T18:45:12.642088+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v270: 68 pgs: 21 creating+peering, 11 unknown, 36 active+clean; 2.2 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-22T18:45:14.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:13 smithi040 bash[13988]: audit 2024-02-22T18:45:12.892876+0000 mon.a (mon.0) 633 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-22T18:45:14.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:13 smithi040 bash[13988]: cluster 2024-02-22T18:45:12.893033+0000 mon.a (mon.0) 634 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-22T18:45:14.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:13 smithi040 bash[17964]: audit 2024-02-22T18:45:12.892876+0000 mon.a (mon.0) 633 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-22T18:45:14.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:13 smithi040 bash[17964]: cluster 2024-02-22T18:45:12.893033+0000 mon.a (mon.0) 634 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-22T18:45:14.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:13 smithi111 bash[14162]: audit 2024-02-22T18:45:12.892876+0000 mon.a (mon.0) 633 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-22T18:45:14.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:13 smithi111 bash[14162]: cluster 2024-02-22T18:45:12.893033+0000 mon.a (mon.0) 634 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-22T18:45:15.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:14 smithi040 bash[13988]: cluster 2024-02-22T18:45:13.909443+0000 mon.a (mon.0) 635 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-22T18:45:15.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:14 smithi040 bash[13988]: audit 2024-02-22T18:45:13.916175+0000 mon.a (mon.0) 636 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-22T18:45:15.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:14 smithi040 bash[13988]: cluster 2024-02-22T18:45:14.642799+0000 mgr.y (mgr.14138) 321 : cluster [DBG] pgmap v273: 100 pgs: 21 creating+peering, 43 unknown, 36 active+clean; 2.2 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 852 B/s wr, 4 op/s 2024-02-22T18:45:15.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:14 smithi040 bash[17964]: cluster 2024-02-22T18:45:13.909443+0000 mon.a (mon.0) 635 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-22T18:45:15.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:14 smithi040 bash[17964]: audit 2024-02-22T18:45:13.916175+0000 mon.a (mon.0) 636 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-22T18:45:15.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:14 smithi040 bash[17964]: cluster 2024-02-22T18:45:14.642799+0000 mgr.y (mgr.14138) 321 : cluster [DBG] pgmap v273: 100 pgs: 21 creating+peering, 43 unknown, 36 active+clean; 2.2 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 852 B/s wr, 4 op/s 2024-02-22T18:45:15.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:14 smithi111 bash[14162]: cluster 2024-02-22T18:45:13.909443+0000 mon.a (mon.0) 635 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-22T18:45:15.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:14 smithi111 bash[14162]: audit 2024-02-22T18:45:13.916175+0000 mon.a (mon.0) 636 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-22T18:45:15.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:14 smithi111 bash[14162]: cluster 2024-02-22T18:45:14.642799+0000 mgr.y (mgr.14138) 321 : cluster [DBG] pgmap v273: 100 pgs: 21 creating+peering, 43 unknown, 36 active+clean; 2.2 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 852 B/s wr, 4 op/s 2024-02-22T18:45:16.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:15 smithi111 bash[14162]: audit 2024-02-22T18:45:14.911033+0000 mon.a (mon.0) 637 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-22T18:45:16.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:15 smithi111 bash[14162]: cluster 2024-02-22T18:45:14.911559+0000 mon.a (mon.0) 638 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-22T18:45:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:15 smithi040 bash[13988]: audit 2024-02-22T18:45:14.911033+0000 mon.a (mon.0) 637 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-22T18:45:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:15 smithi040 bash[13988]: cluster 2024-02-22T18:45:14.911559+0000 mon.a (mon.0) 638 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-22T18:45:16.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:15 smithi040 bash[17964]: audit 2024-02-22T18:45:14.911033+0000 mon.a (mon.0) 637 : audit [INF] from='client.? 172.21.15.40:0/2154182678' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-22T18:45:16.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:15 smithi040 bash[17964]: cluster 2024-02-22T18:45:14.911559+0000 mon.a (mon.0) 638 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-22T18:45:17.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:16 smithi111 bash[14162]: cluster 2024-02-22T18:45:15.930249+0000 mon.a (mon.0) 639 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-22T18:45:17.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:16 smithi111 bash[14162]: audit 2024-02-22T18:45:15.933087+0000 mon.a (mon.0) 640 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-22T18:45:17.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:16 smithi111 bash[14162]: cluster 2024-02-22T18:45:16.643528+0000 mgr.y (mgr.14138) 322 : cluster [DBG] pgmap v276: 132 pgs: 26 creating+peering, 54 unknown, 52 active+clean; 2.2 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:45:17.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:16 smithi111 bash[14162]: audit 2024-02-22T18:45:16.931915+0000 mon.a (mon.0) 641 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-22T18:45:17.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:16 smithi111 bash[14162]: cluster 2024-02-22T18:45:16.932807+0000 mon.a (mon.0) 642 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-22T18:45:17.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[13988]: cluster 2024-02-22T18:45:15.930249+0000 mon.a (mon.0) 639 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-22T18:45:17.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[13988]: audit 2024-02-22T18:45:15.933087+0000 mon.a (mon.0) 640 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-22T18:45:17.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[13988]: cluster 2024-02-22T18:45:16.643528+0000 mgr.y (mgr.14138) 322 : cluster [DBG] pgmap v276: 132 pgs: 26 creating+peering, 54 unknown, 52 active+clean; 2.2 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:45:17.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[13988]: audit 2024-02-22T18:45:16.931915+0000 mon.a (mon.0) 641 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-22T18:45:17.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[13988]: cluster 2024-02-22T18:45:16.932807+0000 mon.a (mon.0) 642 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-22T18:45:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[17964]: cluster 2024-02-22T18:45:15.930249+0000 mon.a (mon.0) 639 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-22T18:45:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[17964]: audit 2024-02-22T18:45:15.933087+0000 mon.a (mon.0) 640 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-22T18:45:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[17964]: cluster 2024-02-22T18:45:16.643528+0000 mgr.y (mgr.14138) 322 : cluster [DBG] pgmap v276: 132 pgs: 26 creating+peering, 54 unknown, 52 active+clean; 2.2 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:45:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[17964]: audit 2024-02-22T18:45:16.931915+0000 mon.a (mon.0) 641 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-22T18:45:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:16 smithi040 bash[17964]: cluster 2024-02-22T18:45:16.932807+0000 mon.a (mon.0) 642 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-22T18:45:18.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:17 smithi111 bash[14162]: audit 2024-02-22T18:45:16.939450+0000 mon.a (mon.0) 643 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-22T18:45:18.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:17 smithi111 bash[14162]: audit 2024-02-22T18:45:17.936086+0000 mon.a (mon.0) 644 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-22T18:45:18.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:17 smithi111 bash[14162]: cluster 2024-02-22T18:45:17.936459+0000 mon.a (mon.0) 645 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-22T18:45:18.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:17 smithi111 bash[14162]: audit 2024-02-22T18:45:17.938173+0000 mon.a (mon.0) 646 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-22T18:45:18.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:17 smithi040 bash[13988]: audit 2024-02-22T18:45:16.939450+0000 mon.a (mon.0) 643 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-22T18:45:18.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:17 smithi040 bash[13988]: audit 2024-02-22T18:45:17.936086+0000 mon.a (mon.0) 644 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-22T18:45:18.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:17 smithi040 bash[13988]: cluster 2024-02-22T18:45:17.936459+0000 mon.a (mon.0) 645 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-22T18:45:18.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:17 smithi040 bash[13988]: audit 2024-02-22T18:45:17.938173+0000 mon.a (mon.0) 646 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-22T18:45:18.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:17 smithi040 bash[17964]: audit 2024-02-22T18:45:16.939450+0000 mon.a (mon.0) 643 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-22T18:45:18.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:17 smithi040 bash[17964]: audit 2024-02-22T18:45:17.936086+0000 mon.a (mon.0) 644 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-22T18:45:18.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:17 smithi040 bash[17964]: cluster 2024-02-22T18:45:17.936459+0000 mon.a (mon.0) 645 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-22T18:45:18.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:17 smithi040 bash[17964]: audit 2024-02-22T18:45:17.938173+0000 mon.a (mon.0) 646 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-22T18:45:19.148 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "b588b5cf-4dfa-455c-83bc-5f040f85fe46", 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 1, 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "predecessor_uuid": "fe2da510-5c6b-4696-b3af-3192aa23e7b9", 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_status": [], 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "period_map": { 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "b588b5cf-4dfa-455c-83bc-5f040f85fe46", 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "zonegroups": [ 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "5a48f7af-b3b6-4652-adeb-b3df77a84957", 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default", 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "api_name": "default", 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "is_master": "true", 2024-02-22T18:45:19.149 INFO:teuthology.orchestra.run.smithi040.stdout: "endpoints": [], 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "hostnames": [], 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "hostnames_s3website": [], 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "master_zone": "30019451-a0f8-4d5e-bb0d-1fd519518d3c", 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "zones": [ 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "30019451-a0f8-4d5e-bb0d-1fd519518d3c", 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "z", 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "endpoints": [], 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "log_meta": "false", 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "log_data": "false", 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "bucket_index_max_shards": 11, 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "read_only": "false", 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "tier_type": "", 2024-02-22T18:45:19.150 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_from_all": "true", 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_from": [], 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect_zone": "" 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: "placement_targets": [ 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default-placement", 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_classes": [ 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: "STANDARD" 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: "default_placement": "default-placement", 2024-02-22T18:45:19.151 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_id": "13206693-ac4b-4b10-9a16-38d32d5262a8", 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_policy": { 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: "groups": [] 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: "short_zone_ids": [ 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "30019451-a0f8-4d5e-bb0d-1fd519518d3c", 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: "val": 762306948 2024-02-22T18:45:19.152 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "master_zonegroup": "5a48f7af-b3b6-4652-adeb-b3df77a84957", 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "master_zone": "30019451-a0f8-4d5e-bb0d-1fd519518d3c", 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "period_config": { 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "bucket_quota": { 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": false, 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "check_on_raw": false, 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "max_size": -1, 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "max_size_kb": 0, 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "max_objects": -1 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "user_quota": { 2024-02-22T18:45:19.153 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": false, 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout: "check_on_raw": false, 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout: "max_size": -1, 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout: "max_size_kb": 0, 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout: "max_objects": -1 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_id": "13206693-ac4b-4b10-9a16-38d32d5262a8", 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_name": "r", 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_epoch": 2 2024-02-22T18:45:19.154 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-22T18:45:19.297 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:18 smithi040 bash[13988]: cluster 2024-02-22T18:45:18.644225+0000 mgr.y (mgr.14138) 323 : cluster [DBG] pgmap v279: 132 pgs: 5 creating+peering, 11 unknown, 116 active+clean; 2.2 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-22T18:45:19.297 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:18 smithi040 bash[13988]: audit 2024-02-22T18:45:18.937542+0000 mon.a (mon.0) 647 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-22T18:45:19.297 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:18 smithi040 bash[13988]: cluster 2024-02-22T18:45:18.937743+0000 mon.a (mon.0) 648 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-22T18:45:19.298 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:18 smithi040 bash[17964]: cluster 2024-02-22T18:45:18.644225+0000 mgr.y (mgr.14138) 323 : cluster [DBG] pgmap v279: 132 pgs: 5 creating+peering, 11 unknown, 116 active+clean; 2.2 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-22T18:45:19.298 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:18 smithi040 bash[17964]: audit 2024-02-22T18:45:18.937542+0000 mon.a (mon.0) 647 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-22T18:45:19.298 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:18 smithi040 bash[17964]: cluster 2024-02-22T18:45:18.937743+0000 mon.a (mon.0) 648 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-22T18:45:19.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:18 smithi111 bash[14162]: cluster 2024-02-22T18:45:18.644225+0000 mgr.y (mgr.14138) 323 : cluster [DBG] pgmap v279: 132 pgs: 5 creating+peering, 11 unknown, 116 active+clean; 2.2 KiB data, 4.7 MiB used, 707 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-22T18:45:19.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:18 smithi111 bash[14162]: audit 2024-02-22T18:45:18.937542+0000 mon.a (mon.0) 647 : audit [INF] from='client.? 172.21.15.40:0/3693820263' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-22T18:45:19.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:18 smithi111 bash[14162]: cluster 2024-02-22T18:45:18.937743+0000 mon.a (mon.0) 648 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-22T18:45:20.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch apply rgw r z --placement=2 --port=8000' 2024-02-22T18:45:20.983 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:20 smithi040 bash[13988]: cluster 2024-02-22T18:45:20.645175+0000 mgr.y (mgr.14138) 324 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 3.9 KiB data, 5.0 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-02-22T18:45:20.983 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:20 smithi040 bash[17964]: cluster 2024-02-22T18:45:20.645175+0000 mgr.y (mgr.14138) 324 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 3.9 KiB data, 5.0 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-02-22T18:45:21.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:20 smithi111 bash[14162]: cluster 2024-02-22T18:45:20.645175+0000 mgr.y (mgr.14138) 324 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 3.9 KiB data, 5.0 MiB used, 707 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-02-22T18:45:22.943 INFO:teuthology.orchestra.run.smithi040.stdout:Scheduled rgw.r.z update... 2024-02-22T18:45:23.138 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:22 smithi040 bash[13988]: cluster 2024-02-22T18:45:22.646228+0000 mgr.y (mgr.14138) 325 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 7.3 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 2.8 KiB/s rd, 6.5 KiB/s wr, 25 op/s 2024-02-22T18:45:23.138 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:22 smithi040 bash[17964]: cluster 2024-02-22T18:45:22.646228+0000 mgr.y (mgr.14138) 325 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 7.3 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 2.8 KiB/s rd, 6.5 KiB/s wr, 25 op/s 2024-02-22T18:45:23.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:22 smithi111 bash[14162]: cluster 2024-02-22T18:45:22.646228+0000 mgr.y (mgr.14138) 325 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 7.3 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 2.8 KiB/s rd, 6.5 KiB/s wr, 25 op/s 2024-02-22T18:45:23.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'sleep 180' 2024-02-22T18:45:24.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:22.932179+0000 mgr.y (mgr.14138) 326 : audit [DBG] from='client.24625 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:45:24.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: cephadm 2024-02-22T18:45:22.933064+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:22.938869+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: cephadm 2024-02-22T18:45:22.939997+0000 mgr.y (mgr.14138) 328 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.292709+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.297892+0000 mon.a (mon.0) 651 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.299655+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi111.qafphs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.306612+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi111.qafphs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.536049+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.545560+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.554638+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: cephadm 2024-02-22T18:45:23.555895+0000 mgr.y (mgr.14138) 329 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.561284+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.562796+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi111.qafphs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.564481+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:45:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: cephadm 2024-02-22T18:45:23.565732+0000 mgr.y (mgr.14138) 330 : cephadm [INF] Deploying daemon rgw.r.z.smithi111.qafphs on smithi111 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[13988]: audit 2024-02-22T18:45:23.566418+0000 mon.a (mon.0) 660 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi111.qafphs", "key": "container_image"}]: dispatch 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:22.932179+0000 mgr.y (mgr.14138) 326 : audit [DBG] from='client.24625 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: cephadm 2024-02-22T18:45:22.933064+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:22.938869+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: cephadm 2024-02-22T18:45:22.939997+0000 mgr.y (mgr.14138) 328 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.292709+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.297892+0000 mon.a (mon.0) 651 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.299655+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi111.qafphs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.306612+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi111.qafphs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.536049+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.545560+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.554638+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: cephadm 2024-02-22T18:45:23.555895+0000 mgr.y (mgr.14138) 329 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-22T18:45:24.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.561284+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.562796+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi111.qafphs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T18:45:24.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.564481+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:45:24.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: cephadm 2024-02-22T18:45:23.565732+0000 mgr.y (mgr.14138) 330 : cephadm [INF] Deploying daemon rgw.r.z.smithi111.qafphs on smithi111 2024-02-22T18:45:24.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:23 smithi040 bash[17964]: audit 2024-02-22T18:45:23.566418+0000 mon.a (mon.0) 660 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi111.qafphs", "key": "container_image"}]: dispatch 2024-02-22T18:45:24.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:22.932179+0000 mgr.y (mgr.14138) 326 : audit [DBG] from='client.24625 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:45:24.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: cephadm 2024-02-22T18:45:22.933064+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:22.938869+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: cephadm 2024-02-22T18:45:22.939997+0000 mgr.y (mgr.14138) 328 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.292709+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.297892+0000 mon.a (mon.0) 651 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.299655+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi111.qafphs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.306612+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi111.qafphs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.536049+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.545560+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.554638+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: cephadm 2024-02-22T18:45:23.555895+0000 mgr.y (mgr.14138) 329 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.561284+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.562796+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi111.qafphs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T18:45:24.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.564481+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:45:24.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: cephadm 2024-02-22T18:45:23.565732+0000 mgr.y (mgr.14138) 330 : cephadm [INF] Deploying daemon rgw.r.z.smithi111.qafphs on smithi111 2024-02-22T18:45:24.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: audit 2024-02-22T18:45:23.566418+0000 mon.a (mon.0) 660 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi111.qafphs", "key": "container_image"}]: dispatch 2024-02-22T18:45:25.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:24 smithi040 bash[13988]: cluster 2024-02-22T18:45:24.646989+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 7.3 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 2.2 KiB/s rd, 5.1 KiB/s wr, 20 op/s 2024-02-22T18:45:25.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:24 smithi040 bash[17964]: cluster 2024-02-22T18:45:24.646989+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 7.3 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 2.2 KiB/s rd, 5.1 KiB/s wr, 20 op/s 2024-02-22T18:45:25.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:24 smithi111 bash[14162]: cluster 2024-02-22T18:45:24.646989+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 7.3 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 2.2 KiB/s rd, 5.1 KiB/s wr, 20 op/s 2024-02-22T18:45:27.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:27 smithi111 bash[14162]: audit 2024-02-22T18:45:26.238885+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:27.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:27 smithi111 bash[14162]: audit 2024-02-22T18:45:26.241133+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.pyjfss", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T18:45:27.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:27 smithi111 bash[14162]: audit 2024-02-22T18:45:26.247331+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.pyjfss", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T18:45:27.468 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:27 smithi111 bash[14162]: audit 2024-02-22T18:45:26.248822+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:45:27.468 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:27 smithi111 bash[14162]: cephadm 2024-02-22T18:45:26.249866+0000 mgr.y (mgr.14138) 332 : cephadm [INF] Deploying daemon rgw.r.z.smithi040.pyjfss on smithi040 2024-02-22T18:45:27.468 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:27 smithi111 bash[14162]: audit 2024-02-22T18:45:26.250608+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi040.pyjfss", "key": "container_image"}]: dispatch 2024-02-22T18:45:27.468 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:27 smithi111 bash[14162]: cluster 2024-02-22T18:45:26.648142+0000 mgr.y (mgr.14138) 333 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 7.3 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.6 KiB/s rd, 4.5 KiB/s wr, 17 op/s 2024-02-22T18:45:27.529 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[13988]: audit 2024-02-22T18:45:26.238885+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:27.530 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[13988]: audit 2024-02-22T18:45:26.241133+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.pyjfss", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T18:45:27.530 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[13988]: audit 2024-02-22T18:45:26.247331+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.pyjfss", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T18:45:27.530 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[13988]: audit 2024-02-22T18:45:26.248822+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:45:27.530 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[13988]: cephadm 2024-02-22T18:45:26.249866+0000 mgr.y (mgr.14138) 332 : cephadm [INF] Deploying daemon rgw.r.z.smithi040.pyjfss on smithi040 2024-02-22T18:45:27.530 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[13988]: audit 2024-02-22T18:45:26.250608+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi040.pyjfss", "key": "container_image"}]: dispatch 2024-02-22T18:45:27.530 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[13988]: cluster 2024-02-22T18:45:26.648142+0000 mgr.y (mgr.14138) 333 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 7.3 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.6 KiB/s rd, 4.5 KiB/s wr, 17 op/s 2024-02-22T18:45:27.530 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[17964]: audit 2024-02-22T18:45:26.238885+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:27.530 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[17964]: audit 2024-02-22T18:45:26.241133+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.pyjfss", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T18:45:27.531 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[17964]: audit 2024-02-22T18:45:26.247331+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.pyjfss", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T18:45:27.531 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[17964]: audit 2024-02-22T18:45:26.248822+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:45:27.531 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[17964]: cephadm 2024-02-22T18:45:26.249866+0000 mgr.y (mgr.14138) 332 : cephadm [INF] Deploying daemon rgw.r.z.smithi040.pyjfss on smithi040 2024-02-22T18:45:27.531 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[17964]: audit 2024-02-22T18:45:26.250608+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi040.pyjfss", "key": "container_image"}]: dispatch 2024-02-22T18:45:27.531 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:27 smithi040 bash[17964]: cluster 2024-02-22T18:45:26.648142+0000 mgr.y (mgr.14138) 333 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 7.3 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.6 KiB/s rd, 4.5 KiB/s wr, 17 op/s 2024-02-22T18:45:29.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:28 smithi040 bash[13988]: cluster 2024-02-22T18:45:28.648924+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 14 KiB/s rd, 4.0 KiB/s wr, 38 op/s 2024-02-22T18:45:29.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:28 smithi040 bash[17964]: cluster 2024-02-22T18:45:28.648924+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 14 KiB/s rd, 4.0 KiB/s wr, 38 op/s 2024-02-22T18:45:29.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:28 smithi111 bash[14162]: cluster 2024-02-22T18:45:28.648924+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 14 KiB/s rd, 4.0 KiB/s wr, 38 op/s 2024-02-22T18:45:30.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:29 smithi040 bash[13988]: audit 2024-02-22T18:45:28.821861+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:30.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:29 smithi040 bash[13988]: audit 2024-02-22T18:45:28.823546+0000 mon.a (mon.0) 667 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:45:30.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:29 smithi040 bash[13988]: audit 2024-02-22T18:45:28.823913+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:45:30.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:29 smithi040 bash[17964]: audit 2024-02-22T18:45:28.821861+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:30.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:29 smithi040 bash[17964]: audit 2024-02-22T18:45:28.823546+0000 mon.a (mon.0) 667 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:45:30.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:29 smithi040 bash[17964]: audit 2024-02-22T18:45:28.823913+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:45:30.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:29 smithi111 bash[14162]: audit 2024-02-22T18:45:28.821861+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:30.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:29 smithi111 bash[14162]: audit 2024-02-22T18:45:28.823546+0000 mon.a (mon.0) 667 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:45:30.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:29 smithi111 bash[14162]: audit 2024-02-22T18:45:28.823913+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:45:31.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[13988]: audit 2024-02-22T18:45:29.994566+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[13988]: audit 2024-02-22T18:45:30.309626+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[13988]: audit 2024-02-22T18:45:30.317180+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[13988]: audit 2024-02-22T18:45:30.331361+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[13988]: cluster 2024-02-22T18:45:30.650101+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 33 KiB/s rd, 3.4 KiB/s wr, 71 op/s 2024-02-22T18:45:31.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[17964]: audit 2024-02-22T18:45:29.994566+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[17964]: audit 2024-02-22T18:45:30.309626+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[17964]: audit 2024-02-22T18:45:30.317180+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[17964]: audit 2024-02-22T18:45:30.331361+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:30 smithi040 bash[17964]: cluster 2024-02-22T18:45:30.650101+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 33 KiB/s rd, 3.4 KiB/s wr, 71 op/s 2024-02-22T18:45:31.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:30 smithi111 bash[14162]: audit 2024-02-22T18:45:29.994566+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:30 smithi111 bash[14162]: audit 2024-02-22T18:45:30.309626+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:30 smithi111 bash[14162]: audit 2024-02-22T18:45:30.317180+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:30 smithi111 bash[14162]: audit 2024-02-22T18:45:30.331361+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:45:31.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:30 smithi111 bash[14162]: cluster 2024-02-22T18:45:30.650101+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 33 KiB/s rd, 3.4 KiB/s wr, 71 op/s 2024-02-22T18:45:33.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:32 smithi040 bash[13988]: cluster 2024-02-22T18:45:32.651434+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 92 KiB/s rd, 2.6 KiB/s wr, 171 op/s 2024-02-22T18:45:33.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:32 smithi040 bash[17964]: cluster 2024-02-22T18:45:32.651434+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 92 KiB/s rd, 2.6 KiB/s wr, 171 op/s 2024-02-22T18:45:33.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:32 smithi111 bash[14162]: cluster 2024-02-22T18:45:32.651434+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 92 KiB/s rd, 2.6 KiB/s wr, 171 op/s 2024-02-22T18:45:35.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:34 smithi040 bash[17964]: cluster 2024-02-22T18:45:34.652196+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 91 KiB/s rd, 170 B/s wr, 161 op/s 2024-02-22T18:45:35.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:34 smithi040 bash[13988]: cluster 2024-02-22T18:45:34.652196+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 91 KiB/s rd, 170 B/s wr, 161 op/s 2024-02-22T18:45:35.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:34 smithi111 bash[14162]: cluster 2024-02-22T18:45:34.652196+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 91 KiB/s rd, 170 B/s wr, 161 op/s 2024-02-22T18:45:37.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:36 smithi040 bash[17964]: cluster 2024-02-22T18:45:36.653256+0000 mgr.y (mgr.14138) 338 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 170 B/s wr, 167 op/s 2024-02-22T18:45:37.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:36 smithi040 bash[13988]: cluster 2024-02-22T18:45:36.653256+0000 mgr.y (mgr.14138) 338 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 170 B/s wr, 167 op/s 2024-02-22T18:45:37.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:36 smithi111 bash[14162]: cluster 2024-02-22T18:45:36.653256+0000 mgr.y (mgr.14138) 338 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 170 B/s wr, 167 op/s 2024-02-22T18:45:39.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:38 smithi040 bash[13988]: cluster 2024-02-22T18:45:38.654410+0000 mgr.y (mgr.14138) 339 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 170 B/s wr, 167 op/s 2024-02-22T18:45:39.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:38 smithi040 bash[17964]: cluster 2024-02-22T18:45:38.654410+0000 mgr.y (mgr.14138) 339 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 170 B/s wr, 167 op/s 2024-02-22T18:45:39.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:38 smithi111 bash[14162]: cluster 2024-02-22T18:45:38.654410+0000 mgr.y (mgr.14138) 339 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 170 B/s wr, 167 op/s 2024-02-22T18:45:41.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:40 smithi040 bash[13988]: cluster 2024-02-22T18:45:40.655423+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 84 KiB/s rd, 85 B/s wr, 148 op/s 2024-02-22T18:45:41.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:40 smithi040 bash[17964]: cluster 2024-02-22T18:45:40.655423+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 84 KiB/s rd, 85 B/s wr, 148 op/s 2024-02-22T18:45:41.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:40 smithi111 bash[14162]: cluster 2024-02-22T18:45:40.655423+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 84 KiB/s rd, 85 B/s wr, 148 op/s 2024-02-22T18:45:43.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:42 smithi040 bash[13988]: cluster 2024-02-22T18:45:42.656664+0000 mgr.y (mgr.14138) 341 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 64 KiB/s rd, 85 B/s wr, 111 op/s 2024-02-22T18:45:43.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:42 smithi040 bash[13988]: audit 2024-02-22T18:45:42.756130+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:45:43.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:42 smithi040 bash[13988]: audit 2024-02-22T18:45:42.771107+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:45:43.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:42 smithi040 bash[17964]: cluster 2024-02-22T18:45:42.656664+0000 mgr.y (mgr.14138) 341 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 64 KiB/s rd, 85 B/s wr, 111 op/s 2024-02-22T18:45:43.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:42 smithi040 bash[17964]: audit 2024-02-22T18:45:42.756130+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:45:43.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:42 smithi040 bash[17964]: audit 2024-02-22T18:45:42.771107+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:45:43.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:42 smithi111 bash[14162]: cluster 2024-02-22T18:45:42.656664+0000 mgr.y (mgr.14138) 341 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 64 KiB/s rd, 85 B/s wr, 111 op/s 2024-02-22T18:45:43.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:42 smithi111 bash[14162]: audit 2024-02-22T18:45:42.756130+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:45:43.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:42 smithi111 bash[14162]: audit 2024-02-22T18:45:42.771107+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:45:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:44 smithi040 bash[13988]: cluster 2024-02-22T18:45:44.657370+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-22T18:45:45.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:44 smithi040 bash[17964]: cluster 2024-02-22T18:45:44.657370+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-22T18:45:45.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:44 smithi111 bash[14162]: cluster 2024-02-22T18:45:44.657370+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-22T18:45:47.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:46 smithi040 bash[13988]: cluster 2024-02-22T18:45:46.658359+0000 mgr.y (mgr.14138) 343 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-22T18:45:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:46 smithi040 bash[17964]: cluster 2024-02-22T18:45:46.658359+0000 mgr.y (mgr.14138) 343 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-22T18:45:47.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:46 smithi111 bash[14162]: cluster 2024-02-22T18:45:46.658359+0000 mgr.y (mgr.14138) 343 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-22T18:45:49.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:48 smithi040 bash[13988]: cluster 2024-02-22T18:45:48.659639+0000 mgr.y (mgr.14138) 344 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:45:49.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:48 smithi040 bash[17964]: cluster 2024-02-22T18:45:48.659639+0000 mgr.y (mgr.14138) 344 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:45:49.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:48 smithi111 bash[14162]: cluster 2024-02-22T18:45:48.659639+0000 mgr.y (mgr.14138) 344 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:45:51.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:50 smithi040 bash[13988]: cluster 2024-02-22T18:45:50.660692+0000 mgr.y (mgr.14138) 345 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:45:51.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:50 smithi040 bash[17964]: cluster 2024-02-22T18:45:50.660692+0000 mgr.y (mgr.14138) 345 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:45:51.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:50 smithi111 bash[14162]: cluster 2024-02-22T18:45:50.660692+0000 mgr.y (mgr.14138) 345 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:45:53.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:52 smithi040 bash[13988]: cluster 2024-02-22T18:45:52.662064+0000 mgr.y (mgr.14138) 346 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:45:53.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:52 smithi040 bash[17964]: cluster 2024-02-22T18:45:52.662064+0000 mgr.y (mgr.14138) 346 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:45:53.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:52 smithi111 bash[14162]: cluster 2024-02-22T18:45:52.662064+0000 mgr.y (mgr.14138) 346 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:45:56.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:55 smithi040 bash[13988]: cluster 2024-02-22T18:45:54.662826+0000 mgr.y (mgr.14138) 347 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:45:56.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:55 smithi040 bash[17964]: cluster 2024-02-22T18:45:54.662826+0000 mgr.y (mgr.14138) 347 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:45:56.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:55 smithi111 bash[14162]: cluster 2024-02-22T18:45:54.662826+0000 mgr.y (mgr.14138) 347 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:45:58.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:57 smithi040 bash[13988]: cluster 2024-02-22T18:45:56.664033+0000 mgr.y (mgr.14138) 348 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:45:58.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:57 smithi040 bash[17964]: cluster 2024-02-22T18:45:56.664033+0000 mgr.y (mgr.14138) 348 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:45:58.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:57 smithi111 bash[14162]: cluster 2024-02-22T18:45:56.664033+0000 mgr.y (mgr.14138) 348 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:00.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:45:59 smithi040 bash[13988]: cluster 2024-02-22T18:45:58.665238+0000 mgr.y (mgr.14138) 349 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:00.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:45:59 smithi040 bash[17964]: cluster 2024-02-22T18:45:58.665238+0000 mgr.y (mgr.14138) 349 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:00.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:45:59 smithi111 bash[14162]: cluster 2024-02-22T18:45:58.665238+0000 mgr.y (mgr.14138) 349 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:02.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:01 smithi040 bash[13988]: cluster 2024-02-22T18:46:00.666226+0000 mgr.y (mgr.14138) 350 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:02.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:01 smithi040 bash[17964]: cluster 2024-02-22T18:46:00.666226+0000 mgr.y (mgr.14138) 350 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:02.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:01 smithi111 bash[14162]: cluster 2024-02-22T18:46:00.666226+0000 mgr.y (mgr.14138) 350 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:04.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:03 smithi040 bash[17964]: cluster 2024-02-22T18:46:02.667482+0000 mgr.y (mgr.14138) 351 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:04.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:03 smithi040 bash[13988]: cluster 2024-02-22T18:46:02.667482+0000 mgr.y (mgr.14138) 351 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:04.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:03 smithi111 bash[14162]: cluster 2024-02-22T18:46:02.667482+0000 mgr.y (mgr.14138) 351 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:05 smithi040 bash[17964]: cluster 2024-02-22T18:46:04.668184+0000 mgr.y (mgr.14138) 352 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:06.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:05 smithi040 bash[13988]: cluster 2024-02-22T18:46:04.668184+0000 mgr.y (mgr.14138) 352 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:06.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:05 smithi111 bash[14162]: cluster 2024-02-22T18:46:04.668184+0000 mgr.y (mgr.14138) 352 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:08.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:07 smithi040 bash[17964]: cluster 2024-02-22T18:46:06.669236+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:08.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:07 smithi040 bash[13988]: cluster 2024-02-22T18:46:06.669236+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:08.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:07 smithi111 bash[14162]: cluster 2024-02-22T18:46:06.669236+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:10.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:09 smithi040 bash[13988]: cluster 2024-02-22T18:46:08.670554+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:10.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:09 smithi040 bash[17964]: cluster 2024-02-22T18:46:08.670554+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:10.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:09 smithi111 bash[14162]: cluster 2024-02-22T18:46:08.670554+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:12.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:11 smithi040 bash[13988]: cluster 2024-02-22T18:46:10.671563+0000 mgr.y (mgr.14138) 355 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:46:12.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:11 smithi040 bash[17964]: cluster 2024-02-22T18:46:10.671563+0000 mgr.y (mgr.14138) 355 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:46:12.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:11 smithi111 bash[14162]: cluster 2024-02-22T18:46:10.671563+0000 mgr.y (mgr.14138) 355 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:46:14.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:13 smithi040 bash[13988]: cluster 2024-02-22T18:46:12.672805+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:14.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:13 smithi040 bash[17964]: cluster 2024-02-22T18:46:12.672805+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:14.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:13 smithi111 bash[14162]: cluster 2024-02-22T18:46:12.672805+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:16.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:15 smithi040 bash[17964]: cluster 2024-02-22T18:46:14.673614+0000 mgr.y (mgr.14138) 357 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:46:16.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:15 smithi040 bash[13988]: cluster 2024-02-22T18:46:14.673614+0000 mgr.y (mgr.14138) 357 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:46:16.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:15 smithi111 bash[14162]: cluster 2024-02-22T18:46:14.673614+0000 mgr.y (mgr.14138) 357 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:46:18.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:17 smithi040 bash[13988]: cluster 2024-02-22T18:46:16.674721+0000 mgr.y (mgr.14138) 358 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:46:18.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:17 smithi040 bash[17964]: cluster 2024-02-22T18:46:16.674721+0000 mgr.y (mgr.14138) 358 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:46:18.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:17 smithi111 bash[14162]: cluster 2024-02-22T18:46:16.674721+0000 mgr.y (mgr.14138) 358 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:46:20.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:19 smithi040 bash[17964]: cluster 2024-02-22T18:46:18.675931+0000 mgr.y (mgr.14138) 359 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:20.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:19 smithi040 bash[13988]: cluster 2024-02-22T18:46:18.675931+0000 mgr.y (mgr.14138) 359 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:20.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:19 smithi111 bash[14162]: cluster 2024-02-22T18:46:18.675931+0000 mgr.y (mgr.14138) 359 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:22.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:21 smithi040 bash[17964]: cluster 2024-02-22T18:46:20.677110+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:22.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:21 smithi040 bash[13988]: cluster 2024-02-22T18:46:20.677110+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:22.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:21 smithi111 bash[14162]: cluster 2024-02-22T18:46:20.677110+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:24.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:23 smithi040 bash[17964]: cluster 2024-02-22T18:46:22.678534+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:24.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:23 smithi040 bash[13988]: cluster 2024-02-22T18:46:22.678534+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:24.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:23 smithi111 bash[14162]: cluster 2024-02-22T18:46:22.678534+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:26.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:25 smithi040 bash[17964]: cluster 2024-02-22T18:46:24.679273+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:26.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:25 smithi040 bash[13988]: cluster 2024-02-22T18:46:24.679273+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:26.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:25 smithi111 bash[14162]: cluster 2024-02-22T18:46:24.679273+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:28.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:27 smithi040 bash[13988]: cluster 2024-02-22T18:46:26.680333+0000 mgr.y (mgr.14138) 363 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:28.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:27 smithi040 bash[17964]: cluster 2024-02-22T18:46:26.680333+0000 mgr.y (mgr.14138) 363 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:28.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:27 smithi111 bash[14162]: cluster 2024-02-22T18:46:26.680333+0000 mgr.y (mgr.14138) 363 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:30.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:29 smithi040 bash[17964]: cluster 2024-02-22T18:46:28.681594+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:30.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:29 smithi040 bash[13988]: cluster 2024-02-22T18:46:28.681594+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:30.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:29 smithi111 bash[14162]: cluster 2024-02-22T18:46:28.681594+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:32.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:31 smithi111 bash[14162]: cluster 2024-02-22T18:46:30.682660+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:32.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:31 smithi040 bash[13988]: cluster 2024-02-22T18:46:30.682660+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:32.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:31 smithi040 bash[17964]: cluster 2024-02-22T18:46:30.682660+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:34.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:33 smithi111 bash[14162]: cluster 2024-02-22T18:46:32.683895+0000 mgr.y (mgr.14138) 366 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:34.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:33 smithi040 bash[13988]: cluster 2024-02-22T18:46:32.683895+0000 mgr.y (mgr.14138) 366 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:34.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:33 smithi040 bash[17964]: cluster 2024-02-22T18:46:32.683895+0000 mgr.y (mgr.14138) 366 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:36.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:35 smithi111 bash[14162]: cluster 2024-02-22T18:46:34.684648+0000 mgr.y (mgr.14138) 367 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:36.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:35 smithi040 bash[17964]: cluster 2024-02-22T18:46:34.684648+0000 mgr.y (mgr.14138) 367 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:36.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:35 smithi040 bash[13988]: cluster 2024-02-22T18:46:34.684648+0000 mgr.y (mgr.14138) 367 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:38.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:37 smithi111 bash[14162]: cluster 2024-02-22T18:46:36.685702+0000 mgr.y (mgr.14138) 368 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:38.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:37 smithi040 bash[17964]: cluster 2024-02-22T18:46:36.685702+0000 mgr.y (mgr.14138) 368 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:38.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:37 smithi040 bash[13988]: cluster 2024-02-22T18:46:36.685702+0000 mgr.y (mgr.14138) 368 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:40.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:39 smithi111 bash[14162]: cluster 2024-02-22T18:46:38.687020+0000 mgr.y (mgr.14138) 369 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:40.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:39 smithi040 bash[17964]: cluster 2024-02-22T18:46:38.687020+0000 mgr.y (mgr.14138) 369 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:40.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:39 smithi040 bash[13988]: cluster 2024-02-22T18:46:38.687020+0000 mgr.y (mgr.14138) 369 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:42.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:41 smithi111 bash[14162]: cluster 2024-02-22T18:46:40.688019+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:42.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:41 smithi040 bash[17964]: cluster 2024-02-22T18:46:40.688019+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:42.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:41 smithi040 bash[13988]: cluster 2024-02-22T18:46:40.688019+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:43.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:42 smithi040 bash[17964]: audit 2024-02-22T18:46:42.763013+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:46:43.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:42 smithi040 bash[17964]: audit 2024-02-22T18:46:42.776886+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:46:43.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:42 smithi040 bash[13988]: audit 2024-02-22T18:46:42.763013+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:46:43.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:42 smithi040 bash[13988]: audit 2024-02-22T18:46:42.776886+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:46:43.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:42 smithi111 bash[14162]: audit 2024-02-22T18:46:42.763013+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:46:43.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:42 smithi111 bash[14162]: audit 2024-02-22T18:46:42.776886+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:46:44.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:43 smithi040 bash[13988]: cluster 2024-02-22T18:46:42.689243+0000 mgr.y (mgr.14138) 371 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:44.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:43 smithi040 bash[17964]: cluster 2024-02-22T18:46:42.689243+0000 mgr.y (mgr.14138) 371 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:44.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:43 smithi111 bash[14162]: cluster 2024-02-22T18:46:42.689243+0000 mgr.y (mgr.14138) 371 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:46.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:45 smithi040 bash[13988]: cluster 2024-02-22T18:46:44.689948+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:46.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:45 smithi040 bash[17964]: cluster 2024-02-22T18:46:44.689948+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:46.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:45 smithi111 bash[14162]: cluster 2024-02-22T18:46:44.689948+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:48.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:47 smithi040 bash[13988]: cluster 2024-02-22T18:46:46.691006+0000 mgr.y (mgr.14138) 373 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:48.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:47 smithi040 bash[17964]: cluster 2024-02-22T18:46:46.691006+0000 mgr.y (mgr.14138) 373 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:48.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:47 smithi111 bash[14162]: cluster 2024-02-22T18:46:46.691006+0000 mgr.y (mgr.14138) 373 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:50.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:49 smithi040 bash[13988]: cluster 2024-02-22T18:46:48.692325+0000 mgr.y (mgr.14138) 374 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:50.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:49 smithi040 bash[17964]: cluster 2024-02-22T18:46:48.692325+0000 mgr.y (mgr.14138) 374 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:50.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:49 smithi111 bash[14162]: cluster 2024-02-22T18:46:48.692325+0000 mgr.y (mgr.14138) 374 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:52.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:51 smithi040 bash[13988]: cluster 2024-02-22T18:46:50.693308+0000 mgr.y (mgr.14138) 375 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:52.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:51 smithi040 bash[17964]: cluster 2024-02-22T18:46:50.693308+0000 mgr.y (mgr.14138) 375 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:52.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:51 smithi111 bash[14162]: cluster 2024-02-22T18:46:50.693308+0000 mgr.y (mgr.14138) 375 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:54.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:54 smithi040 bash[13988]: cluster 2024-02-22T18:46:52.694562+0000 mgr.y (mgr.14138) 376 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:54.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:54 smithi040 bash[17964]: cluster 2024-02-22T18:46:52.694562+0000 mgr.y (mgr.14138) 376 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:54.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:54 smithi111 bash[14162]: cluster 2024-02-22T18:46:52.694562+0000 mgr.y (mgr.14138) 376 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:46:56.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:56 smithi040 bash[13988]: cluster 2024-02-22T18:46:54.695255+0000 mgr.y (mgr.14138) 377 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:56.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:56 smithi040 bash[17964]: cluster 2024-02-22T18:46:54.695255+0000 mgr.y (mgr.14138) 377 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:56.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:56 smithi111 bash[14162]: cluster 2024-02-22T18:46:54.695255+0000 mgr.y (mgr.14138) 377 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:58.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:46:58 smithi040 bash[13988]: cluster 2024-02-22T18:46:56.696348+0000 mgr.y (mgr.14138) 378 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:58.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:46:58 smithi040 bash[17964]: cluster 2024-02-22T18:46:56.696348+0000 mgr.y (mgr.14138) 378 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:46:58.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:46:58 smithi111 bash[14162]: cluster 2024-02-22T18:46:56.696348+0000 mgr.y (mgr.14138) 378 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:00.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:00 smithi040 bash[13988]: cluster 2024-02-22T18:46:58.697599+0000 mgr.y (mgr.14138) 379 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:00.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:00 smithi040 bash[17964]: cluster 2024-02-22T18:46:58.697599+0000 mgr.y (mgr.14138) 379 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:00.468 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:00 smithi111 bash[14162]: cluster 2024-02-22T18:46:58.697599+0000 mgr.y (mgr.14138) 379 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:02.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:02 smithi040 bash[13988]: cluster 2024-02-22T18:47:00.698637+0000 mgr.y (mgr.14138) 380 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:02.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:02 smithi040 bash[17964]: cluster 2024-02-22T18:47:00.698637+0000 mgr.y (mgr.14138) 380 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:02.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:02 smithi111 bash[14162]: cluster 2024-02-22T18:47:00.698637+0000 mgr.y (mgr.14138) 380 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:04.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:04 smithi040 bash[13988]: cluster 2024-02-22T18:47:02.699856+0000 mgr.y (mgr.14138) 381 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:04.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:04 smithi040 bash[17964]: cluster 2024-02-22T18:47:02.699856+0000 mgr.y (mgr.14138) 381 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:04.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:04 smithi111 bash[14162]: cluster 2024-02-22T18:47:02.699856+0000 mgr.y (mgr.14138) 381 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:06.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:06 smithi040 bash[13988]: cluster 2024-02-22T18:47:04.700686+0000 mgr.y (mgr.14138) 382 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:06.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:06 smithi040 bash[17964]: cluster 2024-02-22T18:47:04.700686+0000 mgr.y (mgr.14138) 382 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:06.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:06 smithi111 bash[14162]: cluster 2024-02-22T18:47:04.700686+0000 mgr.y (mgr.14138) 382 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:08.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:08 smithi040 bash[13988]: cluster 2024-02-22T18:47:06.701796+0000 mgr.y (mgr.14138) 383 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:08.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:08 smithi040 bash[17964]: cluster 2024-02-22T18:47:06.701796+0000 mgr.y (mgr.14138) 383 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:08.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:08 smithi111 bash[14162]: cluster 2024-02-22T18:47:06.701796+0000 mgr.y (mgr.14138) 383 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:10.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:10 smithi040 bash[13988]: cluster 2024-02-22T18:47:08.703132+0000 mgr.y (mgr.14138) 384 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:10.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:10 smithi040 bash[17964]: cluster 2024-02-22T18:47:08.703132+0000 mgr.y (mgr.14138) 384 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:10.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:10 smithi111 bash[14162]: cluster 2024-02-22T18:47:08.703132+0000 mgr.y (mgr.14138) 384 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:12.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:12 smithi040 bash[13988]: cluster 2024-02-22T18:47:10.704155+0000 mgr.y (mgr.14138) 385 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:12.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:12 smithi040 bash[17964]: cluster 2024-02-22T18:47:10.704155+0000 mgr.y (mgr.14138) 385 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:12.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:12 smithi111 bash[14162]: cluster 2024-02-22T18:47:10.704155+0000 mgr.y (mgr.14138) 385 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:14.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:14 smithi040 bash[13988]: cluster 2024-02-22T18:47:12.705418+0000 mgr.y (mgr.14138) 386 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:14.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:14 smithi040 bash[17964]: cluster 2024-02-22T18:47:12.705418+0000 mgr.y (mgr.14138) 386 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:14.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:14 smithi111 bash[14162]: cluster 2024-02-22T18:47:12.705418+0000 mgr.y (mgr.14138) 386 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:16 smithi040 bash[13988]: cluster 2024-02-22T18:47:14.706109+0000 mgr.y (mgr.14138) 387 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:16 smithi040 bash[17964]: cluster 2024-02-22T18:47:14.706109+0000 mgr.y (mgr.14138) 387 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:16.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:16 smithi111 bash[14162]: cluster 2024-02-22T18:47:14.706109+0000 mgr.y (mgr.14138) 387 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:18.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:18 smithi040 bash[13988]: cluster 2024-02-22T18:47:16.707239+0000 mgr.y (mgr.14138) 388 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:18.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:18 smithi040 bash[17964]: cluster 2024-02-22T18:47:16.707239+0000 mgr.y (mgr.14138) 388 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:18.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:18 smithi111 bash[14162]: cluster 2024-02-22T18:47:16.707239+0000 mgr.y (mgr.14138) 388 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:20.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:20 smithi040 bash[13988]: cluster 2024-02-22T18:47:18.708625+0000 mgr.y (mgr.14138) 389 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:20.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:20 smithi040 bash[17964]: cluster 2024-02-22T18:47:18.708625+0000 mgr.y (mgr.14138) 389 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:20.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:20 smithi111 bash[14162]: cluster 2024-02-22T18:47:18.708625+0000 mgr.y (mgr.14138) 389 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:22.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:22 smithi040 bash[13988]: cluster 2024-02-22T18:47:20.709674+0000 mgr.y (mgr.14138) 390 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:22.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:22 smithi040 bash[17964]: cluster 2024-02-22T18:47:20.709674+0000 mgr.y (mgr.14138) 390 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:22.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:22 smithi111 bash[14162]: cluster 2024-02-22T18:47:20.709674+0000 mgr.y (mgr.14138) 390 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:24.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:24 smithi040 bash[13988]: cluster 2024-02-22T18:47:22.710908+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:24.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:24 smithi040 bash[17964]: cluster 2024-02-22T18:47:22.710908+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:24.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:24 smithi111 bash[14162]: cluster 2024-02-22T18:47:22.710908+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:26.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:26 smithi040 bash[13988]: cluster 2024-02-22T18:47:24.711756+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:26.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:26 smithi040 bash[17964]: cluster 2024-02-22T18:47:24.711756+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:26.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:26 smithi111 bash[14162]: cluster 2024-02-22T18:47:24.711756+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:28.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:28 smithi040 bash[13988]: cluster 2024-02-22T18:47:26.712810+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:28.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:28 smithi040 bash[17964]: cluster 2024-02-22T18:47:26.712810+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:28.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:28 smithi111 bash[14162]: cluster 2024-02-22T18:47:26.712810+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:30.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:30 smithi040 bash[13988]: cluster 2024-02-22T18:47:28.714123+0000 mgr.y (mgr.14138) 394 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:30.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:30 smithi040 bash[17964]: cluster 2024-02-22T18:47:28.714123+0000 mgr.y (mgr.14138) 394 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:30.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:30 smithi111 bash[14162]: cluster 2024-02-22T18:47:28.714123+0000 mgr.y (mgr.14138) 394 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:32.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:32 smithi040 bash[13988]: cluster 2024-02-22T18:47:30.715167+0000 mgr.y (mgr.14138) 395 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:32.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:32 smithi040 bash[17964]: cluster 2024-02-22T18:47:30.715167+0000 mgr.y (mgr.14138) 395 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:32.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:32 smithi111 bash[14162]: cluster 2024-02-22T18:47:30.715167+0000 mgr.y (mgr.14138) 395 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:34.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:34 smithi040 bash[13988]: cluster 2024-02-22T18:47:32.716448+0000 mgr.y (mgr.14138) 396 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:34.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:34 smithi040 bash[17964]: cluster 2024-02-22T18:47:32.716448+0000 mgr.y (mgr.14138) 396 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:34.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:34 smithi111 bash[14162]: cluster 2024-02-22T18:47:32.716448+0000 mgr.y (mgr.14138) 396 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:36.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:36 smithi040 bash[13988]: cluster 2024-02-22T18:47:34.717252+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:36.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:36 smithi040 bash[17964]: cluster 2024-02-22T18:47:34.717252+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:36.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:36 smithi111 bash[14162]: cluster 2024-02-22T18:47:34.717252+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:38.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:38 smithi040 bash[13988]: cluster 2024-02-22T18:47:36.718214+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:38.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:38 smithi040 bash[17964]: cluster 2024-02-22T18:47:36.718214+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:38.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:38 smithi111 bash[14162]: cluster 2024-02-22T18:47:36.718214+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:40.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:40 smithi040 bash[13988]: cluster 2024-02-22T18:47:38.719545+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:40.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:40 smithi040 bash[17964]: cluster 2024-02-22T18:47:38.719545+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:40.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:40 smithi111 bash[14162]: cluster 2024-02-22T18:47:38.719545+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:42.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:42 smithi040 bash[13988]: cluster 2024-02-22T18:47:40.720609+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:42.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:42 smithi040 bash[17964]: cluster 2024-02-22T18:47:40.720609+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:42.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:42 smithi111 bash[14162]: cluster 2024-02-22T18:47:40.720609+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:43.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:43 smithi040 bash[13988]: audit 2024-02-22T18:47:42.768894+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:47:43.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:43 smithi040 bash[13988]: audit 2024-02-22T18:47:42.782460+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:47:43.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:43 smithi040 bash[17964]: audit 2024-02-22T18:47:42.768894+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:47:43.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:43 smithi040 bash[17964]: audit 2024-02-22T18:47:42.782460+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:47:43.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:43 smithi111 bash[14162]: audit 2024-02-22T18:47:42.768894+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:47:43.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:43 smithi111 bash[14162]: audit 2024-02-22T18:47:42.782460+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:47:44.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:44 smithi040 bash[13988]: cluster 2024-02-22T18:47:42.721597+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:44.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:44 smithi040 bash[17964]: cluster 2024-02-22T18:47:42.721597+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:44.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:44 smithi111 bash[14162]: cluster 2024-02-22T18:47:42.721597+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:46.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:46 smithi040 bash[13988]: cluster 2024-02-22T18:47:44.722355+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:46.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:46 smithi040 bash[17964]: cluster 2024-02-22T18:47:44.722355+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:46 smithi111 bash[14162]: cluster 2024-02-22T18:47:44.722355+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:48.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:48 smithi040 bash[17964]: cluster 2024-02-22T18:47:46.723343+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:48.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:48 smithi040 bash[13988]: cluster 2024-02-22T18:47:46.723343+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:48.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:48 smithi111 bash[14162]: cluster 2024-02-22T18:47:46.723343+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:50.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:50 smithi040 bash[17964]: cluster 2024-02-22T18:47:48.724690+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:50.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:50 smithi040 bash[13988]: cluster 2024-02-22T18:47:48.724690+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:50.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:50 smithi111 bash[14162]: cluster 2024-02-22T18:47:48.724690+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:52.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:52 smithi040 bash[17964]: cluster 2024-02-22T18:47:50.725714+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:52.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:52 smithi040 bash[13988]: cluster 2024-02-22T18:47:50.725714+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:52 smithi111 bash[14162]: cluster 2024-02-22T18:47:50.725714+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:54.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:54 smithi040 bash[17964]: cluster 2024-02-22T18:47:52.726967+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:54.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:54 smithi040 bash[13988]: cluster 2024-02-22T18:47:52.726967+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:54.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:54 smithi111 bash[14162]: cluster 2024-02-22T18:47:52.726967+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:47:56.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:56 smithi111 bash[14162]: cluster 2024-02-22T18:47:54.727755+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:56 smithi040 bash[17964]: cluster 2024-02-22T18:47:54.727755+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:56 smithi040 bash[13988]: cluster 2024-02-22T18:47:54.727755+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:58.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:47:58 smithi111 bash[14162]: cluster 2024-02-22T18:47:56.728780+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v359: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:58.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:47:58 smithi040 bash[13988]: cluster 2024-02-22T18:47:56.728780+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v359: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:47:58.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:47:58 smithi040 bash[17964]: cluster 2024-02-22T18:47:56.728780+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v359: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:00.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:00 smithi111 bash[14162]: cluster 2024-02-22T18:47:58.730056+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v360: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:00.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:00 smithi040 bash[13988]: cluster 2024-02-22T18:47:58.730056+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v360: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:00 smithi040 bash[17964]: cluster 2024-02-22T18:47:58.730056+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v360: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:02.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:02 smithi111 bash[14162]: cluster 2024-02-22T18:48:00.731066+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v361: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:02.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:02 smithi040 bash[13988]: cluster 2024-02-22T18:48:00.731066+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v361: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:02.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:02 smithi040 bash[17964]: cluster 2024-02-22T18:48:00.731066+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v361: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:04.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:04 smithi111 bash[14162]: cluster 2024-02-22T18:48:02.732330+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v362: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:04.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:04 smithi040 bash[17964]: cluster 2024-02-22T18:48:02.732330+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v362: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:04.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:04 smithi040 bash[13988]: cluster 2024-02-22T18:48:02.732330+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v362: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:06.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:06 smithi111 bash[14162]: cluster 2024-02-22T18:48:04.733121+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v363: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:06.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:06 smithi040 bash[17964]: cluster 2024-02-22T18:48:04.733121+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v363: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:06.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:06 smithi040 bash[13988]: cluster 2024-02-22T18:48:04.733121+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v363: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:08 smithi040 bash[17964]: cluster 2024-02-22T18:48:06.734117+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v364: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:08 smithi040 bash[13988]: cluster 2024-02-22T18:48:06.734117+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v364: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:08.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:08 smithi111 bash[14162]: cluster 2024-02-22T18:48:06.734117+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v364: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:10.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:10 smithi040 bash[17964]: cluster 2024-02-22T18:48:08.735453+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v365: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:10.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:10 smithi040 bash[13988]: cluster 2024-02-22T18:48:08.735453+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v365: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:10.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:10 smithi111 bash[14162]: cluster 2024-02-22T18:48:08.735453+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v365: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:12.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:12 smithi040 bash[17964]: cluster 2024-02-22T18:48:10.736508+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v366: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:12.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:12 smithi040 bash[13988]: cluster 2024-02-22T18:48:10.736508+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v366: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:12.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:12 smithi111 bash[14162]: cluster 2024-02-22T18:48:10.736508+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v366: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:14.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:14 smithi040 bash[17964]: cluster 2024-02-22T18:48:12.737715+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v367: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:14 smithi040 bash[13988]: cluster 2024-02-22T18:48:12.737715+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v367: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:14.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:14 smithi111 bash[14162]: cluster 2024-02-22T18:48:12.737715+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v367: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:16.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:16 smithi040 bash[13988]: cluster 2024-02-22T18:48:14.738518+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v368: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:16.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:16 smithi040 bash[17964]: cluster 2024-02-22T18:48:14.738518+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v368: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:16.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:16 smithi111 bash[14162]: cluster 2024-02-22T18:48:14.738518+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v368: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:18 smithi040 bash[13988]: cluster 2024-02-22T18:48:16.739509+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v369: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:18 smithi040 bash[17964]: cluster 2024-02-22T18:48:16.739509+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v369: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:18.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:18 smithi111 bash[14162]: cluster 2024-02-22T18:48:16.739509+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v369: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:20.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:20 smithi040 bash[13988]: cluster 2024-02-22T18:48:18.740854+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v370: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:20.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:20 smithi040 bash[17964]: cluster 2024-02-22T18:48:18.740854+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v370: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:20.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:20 smithi111 bash[14162]: cluster 2024-02-22T18:48:18.740854+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v370: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:22 smithi040 bash[13988]: cluster 2024-02-22T18:48:20.741894+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v371: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:22.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:22 smithi040 bash[17964]: cluster 2024-02-22T18:48:20.741894+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v371: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:22.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:22 smithi111 bash[14162]: cluster 2024-02-22T18:48:20.741894+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v371: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:24.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:24 smithi040 bash[13988]: cluster 2024-02-22T18:48:22.743153+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v372: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:24.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:24 smithi040 bash[17964]: cluster 2024-02-22T18:48:22.743153+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v372: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:24.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:24 smithi111 bash[14162]: cluster 2024-02-22T18:48:22.743153+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v372: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:26.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:26 smithi040 bash[13988]: cluster 2024-02-22T18:48:24.743960+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v373: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:26.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:26 smithi040 bash[17964]: cluster 2024-02-22T18:48:24.743960+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v373: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:26.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:26 smithi111 bash[14162]: cluster 2024-02-22T18:48:24.743960+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v373: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:27.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-22T18:48:28.628 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:28 smithi040 bash[13988]: cluster 2024-02-22T18:48:26.744977+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v374: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:28.629 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:28 smithi040 bash[17964]: cluster 2024-02-22T18:48:26.744977+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v374: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:28.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:28 smithi111 bash[14162]: cluster 2024-02-22T18:48:26.744977+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v374: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:30.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:30 smithi040 bash[13988]: cluster 2024-02-22T18:48:28.746326+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v375: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:30.594 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:30 smithi040 bash[17964]: cluster 2024-02-22T18:48:28.746326+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v375: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:30.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:30 smithi111 bash[14162]: cluster 2024-02-22T18:48:28.746326+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v375: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:31.313 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-22T18:48:31.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:31 smithi040 bash[13988]: audit 2024-02-22T18:48:30.561536+0000 mon.a (mon.0) 679 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:48:31.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:31 smithi040 bash[17964]: audit 2024-02-22T18:48:30.561536+0000 mon.a (mon.0) 679 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:48:31.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:31 smithi111 bash[14162]: audit 2024-02-22T18:48:30.561536+0000 mon.a (mon.0) 679 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:48:32.662 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:32 smithi040 bash[13988]: cluster 2024-02-22T18:48:30.747358+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v376: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:32.662 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:32 smithi040 bash[17964]: cluster 2024-02-22T18:48:30.747358+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v376: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:32 smithi111 bash[14162]: cluster 2024-02-22T18:48:30.747358+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v376: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:34.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:34 smithi040 bash[13988]: cluster 2024-02-22T18:48:32.748673+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v377: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:34.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:34 smithi040 bash[13988]: audit 2024-02-22T18:48:34.406910+0000 mon.a (mon.0) 680 : audit [INF] from='client.? 172.21.15.40:0/78272281' entity='client.admin' 2024-02-22T18:48:34.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:34 smithi040 bash[17964]: cluster 2024-02-22T18:48:32.748673+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v377: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:34.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:34 smithi040 bash[17964]: audit 2024-02-22T18:48:34.406910+0000 mon.a (mon.0) 680 : audit [INF] from='client.? 172.21.15.40:0/78272281' entity='client.admin' 2024-02-22T18:48:34.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:34 smithi111 bash[14162]: cluster 2024-02-22T18:48:32.748673+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v377: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:34.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:34 smithi111 bash[14162]: audit 2024-02-22T18:48:34.406910+0000 mon.a (mon.0) 680 : audit [INF] from='client.? 172.21.15.40:0/78272281' entity='client.admin' 2024-02-22T18:48:35.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-22T18:48:36.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:36 smithi040 bash[13988]: cluster 2024-02-22T18:48:34.749477+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v378: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:36.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:36 smithi040 bash[17964]: cluster 2024-02-22T18:48:34.749477+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v378: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:36.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:36 smithi111 bash[14162]: cluster 2024-02-22T18:48:34.749477+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v378: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:38.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ps' 2024-02-22T18:48:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:38 smithi040 bash[17964]: cluster 2024-02-22T18:48:36.750846+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v379: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:38 smithi040 bash[17964]: audit 2024-02-22T18:48:38.097926+0000 mon.a (mon.0) 681 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:48:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:38 smithi040 bash[17964]: audit 2024-02-22T18:48:38.465970+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:38 smithi040 bash[17964]: audit 2024-02-22T18:48:38.472891+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:38 smithi040 bash[13988]: cluster 2024-02-22T18:48:36.750846+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v379: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:38 smithi040 bash[13988]: audit 2024-02-22T18:48:38.097926+0000 mon.a (mon.0) 681 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:48:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:38 smithi040 bash[13988]: audit 2024-02-22T18:48:38.465970+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:38 smithi040 bash[13988]: audit 2024-02-22T18:48:38.472891+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:38.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:38 smithi111 bash[14162]: cluster 2024-02-22T18:48:36.750846+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v379: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:38.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:38 smithi111 bash[14162]: audit 2024-02-22T18:48:38.097926+0000 mon.a (mon.0) 681 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:48:38.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:38 smithi111 bash[14162]: audit 2024-02-22T18:48:38.465970+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:38.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:38 smithi111 bash[14162]: audit 2024-02-22T18:48:38.472891+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:39.913 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:39 smithi040 bash[17964]: cephadm 2024-02-22T18:48:38.468023+0000 mgr.y (mgr.14138) 429 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:48:39.913 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:39 smithi040 bash[17964]: cephadm 2024-02-22T18:48:38.475380+0000 mgr.y (mgr.14138) 430 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:48:39.913 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:39 smithi040 bash[17964]: audit 2024-02-22T18:48:38.834925+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:39.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:39 smithi040 bash[13988]: cephadm 2024-02-22T18:48:38.468023+0000 mgr.y (mgr.14138) 429 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:48:39.914 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:39 smithi040 bash[13988]: cephadm 2024-02-22T18:48:38.475380+0000 mgr.y (mgr.14138) 430 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:48:39.914 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:39 smithi040 bash[13988]: audit 2024-02-22T18:48:38.834925+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:39.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:39 smithi111 bash[14162]: cephadm 2024-02-22T18:48:38.468023+0000 mgr.y (mgr.14138) 429 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:48:39.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:39 smithi111 bash[14162]: cephadm 2024-02-22T18:48:38.475380+0000 mgr.y (mgr.14138) 430 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:48:39.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:39 smithi111 bash[14162]: audit 2024-02-22T18:48:38.834925+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:40.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:40 smithi040 bash[17964]: cluster 2024-02-22T18:48:38.752217+0000 mgr.y (mgr.14138) 431 : cluster [DBG] pgmap v380: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:40.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:40 smithi040 bash[13988]: cluster 2024-02-22T18:48:38.752217+0000 mgr.y (mgr.14138) 431 : cluster [DBG] pgmap v380: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:40.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:40 smithi111 bash[14162]: cluster 2024-02-22T18:48:38.752217+0000 mgr.y (mgr.14138) 431 : cluster [DBG] pgmap v380: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:42.000 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (4m) 3m ago 5m 0.20.0 docker.io/prom/alertmanager:v0.20.0 0881eb8f169f d07d332bcae5 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi111 running (4m) 3m ago 4m 6.6.2 docker.io/ceph/ceph-grafana:6.6.2 a0dce381714a 5ee787fea36d 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi.iscsi.a smithi111 running (6m) 3m ago 6m 3.4 docker.io/ceph/ceph:v15.2.9 dfc483079636 06f3942185e1 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi111 running (9m) 3m ago 9m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 b1738808f694 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 running (11m) 3m ago 11m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 8536cff39497 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (11m) 3m ago 11m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 3c89b7663858 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi111 running (9m) 3m ago 9m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 336462e9a5d0 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (10m) 3m ago 10m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 1f9be7bcd2e0 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (5m) 3m ago 5m 0.18.1 docker.io/prom/node-exporter:v0.18.1 e5a616e4b9cf 3facd7c224ee 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi111 running (5m) 3m ago 5m 0.18.1 docker.io/prom/node-exporter:v0.18.1 e5a616e4b9cf e0f6df3dcf29 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (9m) 3m ago 9m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 6caadfc43004 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (8m) 3m ago 8m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 c752ecdf2341 2024-02-22T18:48:42.001 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (8m) 3m ago 8m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 fa43ac3dae85 2024-02-22T18:48:42.002 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (7m) 3m ago 7m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 df5809aeb58e 2024-02-22T18:48:42.002 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi111 running (7m) 3m ago 7m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 88b0bb37dbaf 2024-02-22T18:48:42.002 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi111 running (7m) 3m ago 7m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 0e91fba2eb35 2024-02-22T18:48:42.002 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi111 running (6m) 3m ago 6m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 7bc8f399b295 2024-02-22T18:48:42.002 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi111 running (6m) 3m ago 6m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 59b477b24a62 2024-02-22T18:48:42.002 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi111 running (4m) 3m ago 5m 2.18.1 docker.io/prom/prometheus:v2.18.1 de242295e225 6e001257aec6 2024-02-22T18:48:42.002 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.pyjfss smithi040 running (3m) 3m ago 3m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 47df35fb3739 2024-02-22T18:48:42.002 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi111.qafphs smithi111 running (3m) 3m ago 3m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 80fcb09b20c7 2024-02-22T18:48:42.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions' 2024-02-22T18:48:42.892 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:42 smithi040 bash[13988]: cluster 2024-02-22T18:48:40.753138+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v381: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:42.893 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:42 smithi040 bash[17964]: cluster 2024-02-22T18:48:40.753138+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v381: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:42.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:42 smithi111 bash[14162]: cluster 2024-02-22T18:48:40.753138+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v381: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:43.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:43 smithi040 bash[17964]: audit 2024-02-22T18:48:41.973964+0000 mgr.y (mgr.14138) 433 : audit [DBG] from='client.24715 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:48:43.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:43 smithi040 bash[17964]: audit 2024-02-22T18:48:42.776797+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:48:43.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:43 smithi040 bash[17964]: audit 2024-02-22T18:48:42.788191+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:48:43.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:43 smithi040 bash[13988]: audit 2024-02-22T18:48:41.973964+0000 mgr.y (mgr.14138) 433 : audit [DBG] from='client.24715 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:48:43.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:43 smithi040 bash[13988]: audit 2024-02-22T18:48:42.776797+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:48:43.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:43 smithi040 bash[13988]: audit 2024-02-22T18:48:42.788191+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:48:43.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:43 smithi111 bash[14162]: audit 2024-02-22T18:48:41.973964+0000 mgr.y (mgr.14138) 433 : audit [DBG] from='client.24715 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:48:43.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:43 smithi111 bash[14162]: audit 2024-02-22T18:48:42.776797+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:48:43.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:43 smithi111 bash[14162]: audit 2024-02-22T18:48:42.788191+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:48:44.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:44 smithi040 bash[13988]: cluster 2024-02-22T18:48:42.753984+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v382: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:44 smithi040 bash[17964]: cluster 2024-02-22T18:48:42.753984+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v382: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:44 smithi111 bash[14162]: cluster 2024-02-22T18:48:42.753984+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v382: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:45.967 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 3 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 2 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 8 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-22T18:48:45.968 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-22T18:48:45.969 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 2 2024-02-22T18:48:45.969 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:48:45.969 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-22T18:48:45.969 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 15 2024-02-22T18:48:45.969 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:48:45.969 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-22T18:48:46.767 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph -s' 2024-02-22T18:48:46.921 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:46 smithi040 bash[17964]: cluster 2024-02-22T18:48:44.754800+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v383: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:46.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:46 smithi040 bash[17964]: audit 2024-02-22T18:48:45.962506+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.40:0/2997897450' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:48:46.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:46 smithi040 bash[13988]: cluster 2024-02-22T18:48:44.754800+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v383: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:46.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:46 smithi040 bash[13988]: audit 2024-02-22T18:48:45.962506+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.40:0/2997897450' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:48:46.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:46 smithi111 bash[14162]: cluster 2024-02-22T18:48:44.754800+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v383: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:46.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:46 smithi111 bash[14162]: audit 2024-02-22T18:48:45.962506+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.40:0/2997897450' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:48:48.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:48 smithi040 bash[13988]: cluster 2024-02-22T18:48:46.755836+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v384: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:48.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:48 smithi040 bash[17964]: cluster 2024-02-22T18:48:46.755836+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v384: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:48.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:48 smithi111 bash[14162]: cluster 2024-02-22T18:48:46.755836+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v384: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:49.956 INFO:teuthology.orchestra.run.smithi040.stdout: cluster: 2024-02-22T18:48:49.956 INFO:teuthology.orchestra.run.smithi040.stdout: id: 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:48:49.956 INFO:teuthology.orchestra.run.smithi040.stdout: health: HEALTH_OK 2024-02-22T18:48:49.956 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:48:49.956 INFO:teuthology.orchestra.run.smithi040.stdout: services: 2024-02-22T18:48:49.956 INFO:teuthology.orchestra.run.smithi040.stdout: mon: 3 daemons, quorum a,c,b (age 9m) 2024-02-22T18:48:49.956 INFO:teuthology.orchestra.run.smithi040.stdout: mgr: y(active, since 11m), standbys: x 2024-02-22T18:48:49.956 INFO:teuthology.orchestra.run.smithi040.stdout: osd: 8 osds: 8 up (since 6m), 8 in (since 6m) 2024-02-22T18:48:49.956 INFO:teuthology.orchestra.run.smithi040.stdout: rgw: 2 daemons active (r.z.smithi040.pyjfss, r.z.smithi111.qafphs) 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: task status: 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: data: 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: pools: 6 pools, 132 pgs 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: objects: 202 objects, 7.4 KiB 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: usage: 8.0 GiB used, 707 GiB / 715 GiB avail 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: pgs: 132 active+clean 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: io: 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-02-22T18:48:49.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:48:50.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ls' 2024-02-22T18:48:50.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:50 smithi111 bash[14162]: cluster 2024-02-22T18:48:48.757246+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v385: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:50.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:50 smithi111 bash[14162]: audit 2024-02-22T18:48:49.951163+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.40:0/2534877283' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:48:51.090 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:50 smithi040 bash[13988]: cluster 2024-02-22T18:48:48.757246+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v385: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:51.090 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:50 smithi040 bash[13988]: audit 2024-02-22T18:48:49.951163+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.40:0/2534877283' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:48:51.090 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:50 smithi040 bash[17964]: cluster 2024-02-22T18:48:48.757246+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v385: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:51.090 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:50 smithi040 bash[17964]: audit 2024-02-22T18:48:49.951163+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.40:0/2534877283' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:48:52.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:52 smithi040 bash[13988]: cluster 2024-02-22T18:48:50.758285+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v386: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:52.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:52 smithi040 bash[17964]: cluster 2024-02-22T18:48:50.758285+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v386: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:52.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:52 smithi111 bash[14162]: cluster 2024-02-22T18:48:50.758285+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v386: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:53.820 INFO:teuthology.orchestra.run.smithi040.stdout:NAME RUNNING REFRESHED AGE PLACEMENT IMAGE NAME IMAGE ID 2024-02-22T18:48:53.820 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager 1/1 3m ago 6m smithi040=a;count:1 docker.io/prom/alertmanager:v0.20.0 0881eb8f169f 2024-02-22T18:48:53.820 INFO:teuthology.orchestra.run.smithi040.stdout:grafana 1/1 3m ago 5m smithi111=a;count:1 docker.io/ceph/ceph-grafana:6.6.2 a0dce381714a 2024-02-22T18:48:53.820 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi.iscsi 1/1 3m ago 6m smithi111=iscsi.a;count:1 docker.io/ceph/ceph:v15.2.9 dfc483079636 2024-02-22T18:48:53.820 INFO:teuthology.orchestra.run.smithi040.stdout:mgr 2/2 3m ago 9m smithi040=y;smithi111=x;count:2 docker.io/ceph/ceph:v15.2.9 dfc483079636 2024-02-22T18:48:53.821 INFO:teuthology.orchestra.run.smithi040.stdout:mon 3/0 3m ago - docker.io/ceph/ceph:v15.2.9 dfc483079636 2024-02-22T18:48:53.821 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter 2/2 3m ago 6m smithi040=a;smithi111=b;count:2 docker.io/prom/node-exporter:v0.18.1 e5a616e4b9cf 2024-02-22T18:48:53.821 INFO:teuthology.orchestra.run.smithi040.stdout:osd.None 8/0 3m ago - docker.io/ceph/ceph:v15.2.9 dfc483079636 2024-02-22T18:48:53.821 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus 1/1 3m ago 6m smithi111=a;count:1 docker.io/prom/prometheus:v2.18.1 de242295e225 2024-02-22T18:48:53.821 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z 2/2 3m ago 3m count:2 docker.io/ceph/ceph:v15.2.9 dfc483079636 2024-02-22T18:48:54.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph config set mgr container_image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-22T18:48:54.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:54 smithi040 bash[13988]: cluster 2024-02-22T18:48:52.759830+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v387: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:54.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:54 smithi040 bash[17964]: cluster 2024-02-22T18:48:52.759830+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v387: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:54.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:54 smithi111 bash[14162]: cluster 2024-02-22T18:48:52.759830+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v387: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:48:55.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:55 smithi040 bash[13988]: audit 2024-02-22T18:48:53.808438+0000 mgr.y (mgr.14138) 440 : audit [DBG] from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:48:55.909 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:55 smithi040 bash[17964]: audit 2024-02-22T18:48:53.808438+0000 mgr.y (mgr.14138) 440 : audit [DBG] from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:48:55.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:55 smithi111 bash[14162]: audit 2024-02-22T18:48:53.808438+0000 mgr.y (mgr.14138) 440 : audit [DBG] from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:48:56.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:56 smithi040 bash[13988]: cluster 2024-02-22T18:48:54.760704+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v388: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:56.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:56 smithi040 bash[17964]: cluster 2024-02-22T18:48:54.760704+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v388: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:56.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:56 smithi111 bash[14162]: cluster 2024-02-22T18:48:54.760704+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v388: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:58.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)"' 2024-02-22T18:48:58.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:58 smithi040 bash[13988]: cluster 2024-02-22T18:48:56.761727+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v389: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:58.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:58 smithi040 bash[13988]: audit 2024-02-22T18:48:57.525044+0000 mon.a (mon.0) 687 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:48:58.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:48:58 smithi040 bash[13988]: audit 2024-02-22T18:48:57.540156+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:58.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:58 smithi040 bash[17964]: cluster 2024-02-22T18:48:56.761727+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v389: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:58.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:58 smithi040 bash[17964]: audit 2024-02-22T18:48:57.525044+0000 mon.a (mon.0) 687 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:48:58.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:48:58 smithi040 bash[17964]: audit 2024-02-22T18:48:57.540156+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:48:58.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:58 smithi111 bash[14162]: cluster 2024-02-22T18:48:56.761727+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v389: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:48:58.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:58 smithi111 bash[14162]: audit 2024-02-22T18:48:57.525044+0000 mon.a (mon.0) 687 : audit [INF] from='client.? ' entity='client.admin' 2024-02-22T18:48:58.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:48:58 smithi111 bash[14162]: audit 2024-02-22T18:48:57.540156+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:49:00.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:00 smithi040 bash[13988]: cluster 2024-02-22T18:48:58.763055+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v390: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:00.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:00 smithi040 bash[17964]: cluster 2024-02-22T18:48:58.763055+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v390: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:00 smithi111 bash[14162]: cluster 2024-02-22T18:48:58.763055+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v390: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:01.676 INFO:teuthology.orchestra.run.smithi040.stdout:Scheduled to redeploy mgr.x on host 'smithi111' 2024-02-22T18:49:01.841 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:01 smithi040 bash[13988]: audit 2024-02-22T18:49:01.330444+0000 mon.a (mon.0) 689 : audit [DBG] from='client.? 172.21.15.40:0/2759304167' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T18:49:01.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:01 smithi040 bash[17964]: audit 2024-02-22T18:49:01.330444+0000 mon.a (mon.0) 689 : audit [DBG] from='client.? 172.21.15.40:0/2759304167' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T18:49:01.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:01 smithi111 bash[14162]: audit 2024-02-22T18:49:01.330444+0000 mon.a (mon.0) 689 : audit [DBG] from='client.? 172.21.15.40:0/2759304167' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T18:49:02.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ps --refresh' 2024-02-22T18:49:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[17964]: cluster 2024-02-22T18:49:00.763768+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v391: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[17964]: audit 2024-02-22T18:49:01.669486+0000 mgr.y (mgr.14138) 445 : audit [DBG] from='client.24751 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:49:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[17964]: cephadm 2024-02-22T18:49:01.670733+0000 mgr.y (mgr.14138) 446 : cephadm [INF] Schedule redeploy daemon mgr.x 2024-02-22T18:49:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[17964]: audit 2024-02-22T18:49:01.678987+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:49:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[17964]: audit 2024-02-22T18:49:01.686162+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-22T18:49:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[17964]: audit 2024-02-22T18:49:01.687279+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:49:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[17964]: cephadm 2024-02-22T18:49:01.688416+0000 mgr.y (mgr.14138) 447 : cephadm [INF] Deploying daemon mgr.x on smithi111 2024-02-22T18:49:02.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[17964]: audit 2024-02-22T18:49:01.689312+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T18:49:02.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[13988]: cluster 2024-02-22T18:49:00.763768+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v391: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:02.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[13988]: audit 2024-02-22T18:49:01.669486+0000 mgr.y (mgr.14138) 445 : audit [DBG] from='client.24751 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:49:02.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[13988]: cephadm 2024-02-22T18:49:01.670733+0000 mgr.y (mgr.14138) 446 : cephadm [INF] Schedule redeploy daemon mgr.x 2024-02-22T18:49:02.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[13988]: audit 2024-02-22T18:49:01.678987+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:49:02.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[13988]: audit 2024-02-22T18:49:01.686162+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-22T18:49:02.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[13988]: audit 2024-02-22T18:49:01.687279+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:49:02.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[13988]: cephadm 2024-02-22T18:49:01.688416+0000 mgr.y (mgr.14138) 447 : cephadm [INF] Deploying daemon mgr.x on smithi111 2024-02-22T18:49:02.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:02 smithi040 bash[13988]: audit 2024-02-22T18:49:01.689312+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T18:49:02.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:02 smithi111 bash[14162]: cluster 2024-02-22T18:49:00.763768+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v391: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:02.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:02 smithi111 bash[14162]: audit 2024-02-22T18:49:01.669486+0000 mgr.y (mgr.14138) 445 : audit [DBG] from='client.24751 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:49:02.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:02 smithi111 bash[14162]: cephadm 2024-02-22T18:49:01.670733+0000 mgr.y (mgr.14138) 446 : cephadm [INF] Schedule redeploy daemon mgr.x 2024-02-22T18:49:02.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:02 smithi111 bash[14162]: audit 2024-02-22T18:49:01.678987+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:49:02.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:02 smithi111 bash[14162]: audit 2024-02-22T18:49:01.686162+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-22T18:49:02.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:02 smithi111 bash[14162]: audit 2024-02-22T18:49:01.687279+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:49:02.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:02 smithi111 bash[14162]: cephadm 2024-02-22T18:49:01.688416+0000 mgr.y (mgr.14138) 447 : cephadm [INF] Deploying daemon mgr.x on smithi111 2024-02-22T18:49:02.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:02 smithi111 bash[14162]: audit 2024-02-22T18:49:01.689312+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T18:49:04.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:04 smithi040 bash[13988]: cluster 2024-02-22T18:49:02.765116+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v392: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:04.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:04 smithi040 bash[17964]: cluster 2024-02-22T18:49:02.765116+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v392: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:04.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:04 smithi111 bash[14162]: cluster 2024-02-22T18:49:02.765116+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v392: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:05.810 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-22T18:49:05.810 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (5m) 3m ago 5m 0.20.0 docker.io/prom/alertmanager:v0.20.0 0881eb8f169f d07d332bcae5 2024-02-22T18:49:05.810 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi111 running (5m) 3m ago 5m 6.6.2 docker.io/ceph/ceph-grafana:6.6.2 a0dce381714a 5ee787fea36d 2024-02-22T18:49:05.810 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi.iscsi.a smithi111 running (6m) 3m ago 6m 3.4 docker.io/ceph/ceph:v15.2.9 dfc483079636 06f3942185e1 2024-02-22T18:49:05.810 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi111 running (9m) 3m ago 9m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 b1738808f694 2024-02-22T18:49:05.810 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 running (11m) 3m ago 11m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 8536cff39497 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (12m) 3m ago 12m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 3c89b7663858 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi111 running (10m) 3m ago 10m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 336462e9a5d0 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (10m) 3m ago 10m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 1f9be7bcd2e0 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (5m) 3m ago 6m 0.18.1 docker.io/prom/node-exporter:v0.18.1 e5a616e4b9cf 3facd7c224ee 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi111 running (5m) 3m ago 5m 0.18.1 docker.io/prom/node-exporter:v0.18.1 e5a616e4b9cf e0f6df3dcf29 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (9m) 3m ago 9m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 6caadfc43004 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (9m) 3m ago 9m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 c752ecdf2341 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (8m) 3m ago 8m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 fa43ac3dae85 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (8m) 3m ago 8m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 df5809aeb58e 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi111 running (7m) 3m ago 7m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 88b0bb37dbaf 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi111 running (7m) 3m ago 7m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 0e91fba2eb35 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi111 running (7m) 3m ago 7m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 7bc8f399b295 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi111 running (6m) 3m ago 6m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 59b477b24a62 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi111 running (5m) 3m ago 6m 2.18.1 docker.io/prom/prometheus:v2.18.1 de242295e225 6e001257aec6 2024-02-22T18:49:05.811 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.pyjfss smithi040 running (3m) 3m ago 3m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 47df35fb3739 2024-02-22T18:49:05.812 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi111.qafphs smithi111 running (3m) 3m ago 3m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 80fcb09b20c7 2024-02-22T18:49:06.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'sleep 180' 2024-02-22T18:49:06.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:06 smithi040 bash[13988]: cluster 2024-02-22T18:49:04.765920+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v393: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:06 smithi040 bash[17964]: cluster 2024-02-22T18:49:04.765920+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v393: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:06.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:06 smithi111 bash[14162]: cluster 2024-02-22T18:49:04.765920+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v393: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:07.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:07 smithi040 bash[13988]: audit 2024-02-22T18:49:05.786046+0000 mgr.y (mgr.14138) 450 : audit [DBG] from='client.24757 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:49:07.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:07 smithi040 bash[13988]: cephadm 2024-02-22T18:49:05.787226+0000 mgr.y (mgr.14138) 451 : cephadm [INF] Kicked serve() loop to refresh all daemons 2024-02-22T18:49:07.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:07 smithi040 bash[17964]: audit 2024-02-22T18:49:05.786046+0000 mgr.y (mgr.14138) 450 : audit [DBG] from='client.24757 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:49:07.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:07 smithi040 bash[17964]: cephadm 2024-02-22T18:49:05.787226+0000 mgr.y (mgr.14138) 451 : cephadm [INF] Kicked serve() loop to refresh all daemons 2024-02-22T18:49:07.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:07 smithi111 bash[14162]: audit 2024-02-22T18:49:05.786046+0000 mgr.y (mgr.14138) 450 : audit [DBG] from='client.24757 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:49:07.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:07 smithi111 bash[14162]: cephadm 2024-02-22T18:49:05.787226+0000 mgr.y (mgr.14138) 451 : cephadm [INF] Kicked serve() loop to refresh all daemons 2024-02-22T18:49:08.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:08 smithi111 bash[14162]: cluster 2024-02-22T18:49:06.766923+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v394: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:09.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:08 smithi040 bash[13988]: cluster 2024-02-22T18:49:06.766923+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v394: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:09.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:08 smithi040 bash[17964]: cluster 2024-02-22T18:49:06.766923+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v394: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:10.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:09 smithi040 bash[13988]: cluster 2024-02-22T18:49:08.767830+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v395: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:10.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:09 smithi040 bash[17964]: cluster 2024-02-22T18:49:08.767830+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v395: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:10.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:09 smithi111 bash[14162]: cluster 2024-02-22T18:49:08.767830+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v395: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:12.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:11 smithi040 bash[13988]: cluster 2024-02-22T18:49:10.768800+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v396: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:12.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:11 smithi040 bash[17964]: cluster 2024-02-22T18:49:10.768800+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v396: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:12.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:11 smithi111 bash[14162]: cluster 2024-02-22T18:49:10.768800+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v396: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:14.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:13 smithi040 bash[13988]: cluster 2024-02-22T18:49:12.769996+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v397: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:14.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:13 smithi040 bash[17964]: cluster 2024-02-22T18:49:12.769996+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v397: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:14.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:13 smithi111 bash[14162]: cluster 2024-02-22T18:49:12.769996+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v397: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:16.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:15 smithi040 bash[13988]: cluster 2024-02-22T18:49:14.770792+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v398: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:16.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:15 smithi040 bash[17964]: cluster 2024-02-22T18:49:14.770792+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v398: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:16.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:15 smithi111 bash[14162]: cluster 2024-02-22T18:49:14.770792+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v398: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:18.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:17 smithi040 bash[13988]: cluster 2024-02-22T18:49:16.771495+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v399: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:18.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:17 smithi040 bash[17964]: cluster 2024-02-22T18:49:16.771495+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v399: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:18.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:17 smithi111 bash[14162]: cluster 2024-02-22T18:49:16.771495+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v399: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:20.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:19 smithi040 bash[13988]: cluster 2024-02-22T18:49:18.772782+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v400: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:20.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:19 smithi040 bash[17964]: cluster 2024-02-22T18:49:18.772782+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v400: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:20.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:19 smithi111 bash[14162]: cluster 2024-02-22T18:49:18.772782+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v400: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:22.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:21 smithi111 bash[14162]: cluster 2024-02-22T18:49:20.773985+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v401: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:22.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:21 smithi040 bash[13988]: cluster 2024-02-22T18:49:20.773985+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v401: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:22.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:21 smithi040 bash[17964]: cluster 2024-02-22T18:49:20.773985+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v401: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:23 smithi111 bash[14162]: cluster 2024-02-22T18:49:22.775272+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v402: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:24.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:23 smithi040 bash[13988]: cluster 2024-02-22T18:49:22.775272+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v402: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:24.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:23 smithi040 bash[17964]: cluster 2024-02-22T18:49:22.775272+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v402: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:26.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:25 smithi111 bash[14162]: cluster 2024-02-22T18:49:24.776003+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v403: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:26.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:25 smithi040 bash[13988]: cluster 2024-02-22T18:49:24.776003+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v403: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:26.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:25 smithi040 bash[17964]: cluster 2024-02-22T18:49:24.776003+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v403: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:28.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:27 smithi111 bash[14162]: cluster 2024-02-22T18:49:26.776980+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v404: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:28.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:27 smithi040 bash[17964]: cluster 2024-02-22T18:49:26.776980+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v404: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:28.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:27 smithi040 bash[13988]: cluster 2024-02-22T18:49:26.776980+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v404: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:30.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:29 smithi111 bash[14162]: cluster 2024-02-22T18:49:28.778277+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v405: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:30.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:29 smithi040 bash[13988]: cluster 2024-02-22T18:49:28.778277+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v405: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:30.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:29 smithi040 bash[17964]: cluster 2024-02-22T18:49:28.778277+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v405: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:32.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:31 smithi111 bash[14162]: cluster 2024-02-22T18:49:30.779286+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v406: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:32.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:31 smithi040 bash[13988]: cluster 2024-02-22T18:49:30.779286+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v406: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:32.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:31 smithi040 bash[17964]: cluster 2024-02-22T18:49:30.779286+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v406: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:34.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:33 smithi111 bash[14162]: cluster 2024-02-22T18:49:32.780165+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v407: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:34.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:33 smithi040 bash[13988]: cluster 2024-02-22T18:49:32.780165+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v407: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:34.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:33 smithi040 bash[17964]: cluster 2024-02-22T18:49:32.780165+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v407: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:36.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:35 smithi040 bash[13988]: cluster 2024-02-22T18:49:34.780967+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v408: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:36.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:35 smithi040 bash[17964]: cluster 2024-02-22T18:49:34.780967+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v408: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:36.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:35 smithi111 bash[14162]: cluster 2024-02-22T18:49:34.780967+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v408: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:38.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:37 smithi040 bash[13988]: cluster 2024-02-22T18:49:36.781934+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v409: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:38.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:37 smithi040 bash[17964]: cluster 2024-02-22T18:49:36.781934+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v409: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:38.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:37 smithi111 bash[14162]: cluster 2024-02-22T18:49:36.781934+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v409: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:40.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:39 smithi040 bash[13988]: cluster 2024-02-22T18:49:38.783236+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v410: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:40.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:39 smithi040 bash[17964]: cluster 2024-02-22T18:49:38.783236+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v410: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:40.468 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:39 smithi111 bash[14162]: cluster 2024-02-22T18:49:38.783236+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v410: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:42.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:41 smithi040 bash[17964]: cluster 2024-02-22T18:49:40.784185+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v411: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:42.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:41 smithi040 bash[13988]: cluster 2024-02-22T18:49:40.784185+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v411: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:42.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:41 smithi111 bash[14162]: cluster 2024-02-22T18:49:40.784185+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v411: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:43.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:42 smithi040 bash[13988]: audit 2024-02-22T18:49:42.789406+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:49:43.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:42 smithi040 bash[13988]: audit 2024-02-22T18:49:42.795262+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:49:43.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:42 smithi040 bash[17964]: audit 2024-02-22T18:49:42.789406+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:49:43.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:42 smithi040 bash[17964]: audit 2024-02-22T18:49:42.795262+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:49:43.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:42 smithi111 bash[14162]: audit 2024-02-22T18:49:42.789406+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:49:43.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:42 smithi111 bash[14162]: audit 2024-02-22T18:49:42.795262+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:49:44.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:43 smithi040 bash[13988]: cluster 2024-02-22T18:49:42.785384+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v412: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:44.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:43 smithi040 bash[17964]: cluster 2024-02-22T18:49:42.785384+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v412: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:44.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:44 smithi111 bash[14162]: cluster 2024-02-22T18:49:42.785384+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v412: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:46.310 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:46 smithi111 bash[14162]: cluster 2024-02-22T18:49:44.786106+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v413: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:46.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:46 smithi040 bash[13988]: cluster 2024-02-22T18:49:44.786106+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v413: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:46.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:46 smithi040 bash[17964]: cluster 2024-02-22T18:49:44.786106+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v413: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:47.466 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:49:47 smithi111 systemd[1]: Stopping Ceph mgr.x for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T18:49:48.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:48 smithi040 bash[13988]: cluster 2024-02-22T18:49:46.787088+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v414: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:48.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:48 smithi040 bash[17964]: cluster 2024-02-22T18:49:46.787088+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v414: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:48.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:48 smithi111 bash[14162]: cluster 2024-02-22T18:49:46.787088+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v414: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:50.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:50 smithi040 bash[13988]: cluster 2024-02-22T18:49:48.788353+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v415: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:50.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:50 smithi040 bash[17964]: cluster 2024-02-22T18:49:48.788353+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v415: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:50.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:50 smithi111 bash[14162]: cluster 2024-02-22T18:49:48.788353+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v415: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:52.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:52 smithi040 bash[13988]: cluster 2024-02-22T18:49:50.789309+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v416: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:52.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:52 smithi040 bash[17964]: cluster 2024-02-22T18:49:50.789309+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v416: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:52.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:52 smithi111 bash[14162]: cluster 2024-02-22T18:49:50.789309+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v416: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:54.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:54 smithi040 bash[13988]: cluster 2024-02-22T18:49:52.790529+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v417: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:54.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:54 smithi040 bash[17964]: cluster 2024-02-22T18:49:52.790529+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v417: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:54.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:54 smithi111 bash[14162]: cluster 2024-02-22T18:49:52.790529+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v417: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:49:56.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:56 smithi040 bash[13988]: cluster 2024-02-22T18:49:54.791332+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v418: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:56.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:56 smithi040 bash[17964]: cluster 2024-02-22T18:49:54.791332+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v418: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:56.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:56 smithi111 bash[14162]: cluster 2024-02-22T18:49:54.791332+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v418: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:58.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:58 smithi040 bash[13988]: cluster 2024-02-22T18:49:56.792330+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v419: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:58.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:58 smithi040 bash[17964]: cluster 2024-02-22T18:49:56.792330+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v419: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:58.466 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:49:58 smithi111 docker[26954]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-mgr.x 2024-02-22T18:49:58.467 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:49:58 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-02-22T18:49:58.467 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:49:58 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-02-22T18:49:58.467 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:49:58 smithi111 systemd[1]: Stopped Ceph mgr.x for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:49:58.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:58 smithi111 bash[14162]: cluster 2024-02-22T18:49:56.792330+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v419: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:49:58.943 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:49:58 smithi111 systemd[1]: Started Ceph mgr.x for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:49:59.668 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:49:59 smithi111 bash[27054]: debug 2024-02-22T18:49:59.485+0000 7f65e953b700 1 -- 172.21.15.111:0/2213901061 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ca7c51e4e0 con 0x55ca7c612800 2024-02-22T18:49:59.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:59 smithi111 bash[14162]: audit 2024-02-22T18:49:58.530291+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:49:59.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:59 smithi111 bash[14162]: audit 2024-02-22T18:49:58.540523+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:49:59.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:49:59 smithi111 bash[14162]: audit 2024-02-22T18:49:58.541419+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:49:59.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:59 smithi040 bash[13988]: audit 2024-02-22T18:49:58.530291+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:49:59.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:59 smithi040 bash[13988]: audit 2024-02-22T18:49:58.540523+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:49:59.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:49:59 smithi040 bash[13988]: audit 2024-02-22T18:49:58.541419+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:49:59.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:59 smithi040 bash[17964]: audit 2024-02-22T18:49:58.530291+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:49:59.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:59 smithi040 bash[17964]: audit 2024-02-22T18:49:58.540523+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:49:59.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:49:59 smithi040 bash[17964]: audit 2024-02-22T18:49:58.541419+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T18:49:59.966 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:49:59 smithi111 bash[27054]: debug 2024-02-22T18:49:59.657+0000 7f65f9b36680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T18:49:59.966 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:49:59 smithi111 bash[27054]: debug 2024-02-22T18:49:59.765+0000 7f65f9b36680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T18:50:00.635 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:00 smithi111 bash[27054]: debug 2024-02-22T18:50:00.249+0000 7f65f9b36680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T18:50:00.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[13988]: cluster 2024-02-22T18:49:58.793217+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v420: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:00.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[13988]: audit 2024-02-22T18:49:59.630405+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:50:00.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[13988]: cephadm 2024-02-22T18:49:59.631635+0000 mgr.y (mgr.14138) 479 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:50:00.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[13988]: cluster 2024-02-22T18:50:00.000159+0000 mon.a (mon.0) 700 : cluster [INF] overall HEALTH_OK 2024-02-22T18:50:00.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[13988]: audit 2024-02-22T18:50:00.578588+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:50:00.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[17964]: cluster 2024-02-22T18:49:58.793217+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v420: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:00.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[17964]: audit 2024-02-22T18:49:59.630405+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:50:00.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[17964]: cephadm 2024-02-22T18:49:59.631635+0000 mgr.y (mgr.14138) 479 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:50:00.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[17964]: cluster 2024-02-22T18:50:00.000159+0000 mon.a (mon.0) 700 : cluster [INF] overall HEALTH_OK 2024-02-22T18:50:00.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:00 smithi040 bash[17964]: audit 2024-02-22T18:50:00.578588+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:50:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:00 smithi111 bash[14162]: cluster 2024-02-22T18:49:58.793217+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v420: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:00 smithi111 bash[14162]: audit 2024-02-22T18:49:59.630405+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:50:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:00 smithi111 bash[14162]: cephadm 2024-02-22T18:49:59.631635+0000 mgr.y (mgr.14138) 479 : cephadm [INF] refreshing smithi040 facts 2024-02-22T18:50:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:00 smithi111 bash[14162]: cluster 2024-02-22T18:50:00.000159+0000 mon.a (mon.0) 700 : cluster [INF] overall HEALTH_OK 2024-02-22T18:50:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:00 smithi111 bash[14162]: audit 2024-02-22T18:50:00.578588+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:50:01.563 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:01 smithi111 bash[27054]: debug 2024-02-22T18:50:01.221+0000 7f65f9b36680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T18:50:01.563 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:01 smithi111 bash[27054]: debug 2024-02-22T18:50:01.313+0000 7f65f9b36680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T18:50:01.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:01 smithi040 bash[17964]: cephadm 2024-02-22T18:50:00.579946+0000 mgr.y (mgr.14138) 480 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:50:01.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:01 smithi040 bash[17964]: audit 2024-02-22T18:50:00.929775+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:50:01.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:01 smithi040 bash[13988]: cephadm 2024-02-22T18:50:00.579946+0000 mgr.y (mgr.14138) 480 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:50:01.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:01 smithi040 bash[13988]: audit 2024-02-22T18:50:00.929775+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:50:01.966 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:01 smithi111 bash[27054]: debug 2024-02-22T18:50:01.557+0000 7f65f9b36680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T18:50:01.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:01 smithi111 bash[14162]: cephadm 2024-02-22T18:50:00.579946+0000 mgr.y (mgr.14138) 480 : cephadm [INF] refreshing smithi111 facts 2024-02-22T18:50:01.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:01 smithi111 bash[14162]: audit 2024-02-22T18:50:00.929775+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' 2024-02-22T18:50:02.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:02 smithi040 bash[13988]: cluster 2024-02-22T18:50:00.794202+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v421: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:02 smithi040 bash[17964]: cluster 2024-02-22T18:50:00.794202+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v421: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:02.936 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:02 smithi111 bash[14162]: cluster 2024-02-22T18:50:00.794202+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v421: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:02.936 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:02 smithi111 bash[27054]: debug 2024-02-22T18:50:02.673+0000 7f65f9b36680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T18:50:02.936 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:02 smithi111 bash[27054]: debug 2024-02-22T18:50:02.833+0000 7f65f9b36680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T18:50:02.936 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:02 smithi111 bash[27054]: debug 2024-02-22T18:50:02.929+0000 7f65f9b36680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T18:50:03.216 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:03 smithi111 bash[27054]: debug 2024-02-22T18:50:03.041+0000 7f65f9b36680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T18:50:03.624 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:03 smithi111 bash[27054]: debug 2024-02-22T18:50:03.257+0000 7f65f9b36680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T18:50:03.966 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:03 smithi111 bash[27054]: debug 2024-02-22T18:50:03.617+0000 7f65f9b36680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T18:50:03.966 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:03 smithi111 bash[27054]: debug 2024-02-22T18:50:03.737+0000 7f65f9b36680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T18:50:04.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:04 smithi040 bash[17964]: cluster 2024-02-22T18:50:02.795458+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v422: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:04.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:04 smithi040 bash[13988]: cluster 2024-02-22T18:50:02.795458+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v422: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:04.966 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:04 smithi111 bash[27054]: debug 2024-02-22T18:50:04.585+0000 7f65f9b36680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T18:50:04.966 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:04 smithi111 bash[27054]: debug 2024-02-22T18:50:04.689+0000 7f65f9b36680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T18:50:04.966 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:04 smithi111 bash[27054]: debug 2024-02-22T18:50:04.801+0000 7f65f9b36680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T18:50:04.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:04 smithi111 bash[14162]: cluster 2024-02-22T18:50:02.795458+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v422: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:05.313 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:05 smithi111 bash[27054]: debug 2024-02-22T18:50:05.017+0000 7f65f9b36680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T18:50:05.644 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:05 smithi111 bash[27054]: debug 2024-02-22T18:50:05.305+0000 7f65f9b36680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T18:50:05.644 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:05 smithi111 bash[27054]: debug 2024-02-22T18:50:05.469+0000 7f65f9b36680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T18:50:05.644 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:05 smithi111 bash[27054]: debug 2024-02-22T18:50:05.637+0000 7f65f9b36680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T18:50:05.962 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:05 smithi111 bash[27054]: debug 2024-02-22T18:50:05.853+0000 7f65f9b36680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T18:50:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[17964]: cluster 2024-02-22T18:50:04.796351+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v423: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[17964]: cluster 2024-02-22T18:50:05.979926+0000 mon.a (mon.0) 703 : cluster [DBG] Standby manager daemon x restarted 2024-02-22T18:50:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[17964]: cluster 2024-02-22T18:50:05.980350+0000 mon.a (mon.0) 704 : cluster [DBG] Standby manager daemon x started 2024-02-22T18:50:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[17964]: audit 2024-02-22T18:50:05.982337+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T18:50:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[17964]: audit 2024-02-22T18:50:05.983417+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:50:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[17964]: audit 2024-02-22T18:50:05.987716+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T18:50:06.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[17964]: audit 2024-02-22T18:50:05.988744+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:50:06.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[13988]: cluster 2024-02-22T18:50:04.796351+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v423: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:06.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[13988]: cluster 2024-02-22T18:50:05.979926+0000 mon.a (mon.0) 703 : cluster [DBG] Standby manager daemon x restarted 2024-02-22T18:50:06.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[13988]: cluster 2024-02-22T18:50:05.980350+0000 mon.a (mon.0) 704 : cluster [DBG] Standby manager daemon x started 2024-02-22T18:50:06.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[13988]: audit 2024-02-22T18:50:05.982337+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T18:50:06.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[13988]: audit 2024-02-22T18:50:05.983417+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:50:06.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[13988]: audit 2024-02-22T18:50:05.987716+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T18:50:06.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:06 smithi040 bash[13988]: audit 2024-02-22T18:50:05.988744+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:50:06.966 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:50:05 smithi111 bash[27054]: debug 2024-02-22T18:50:05.957+0000 7f65f9b36680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T18:50:06.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:06 smithi111 bash[14162]: cluster 2024-02-22T18:50:04.796351+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v423: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:06.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:06 smithi111 bash[14162]: cluster 2024-02-22T18:50:05.979926+0000 mon.a (mon.0) 703 : cluster [DBG] Standby manager daemon x restarted 2024-02-22T18:50:06.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:06 smithi111 bash[14162]: cluster 2024-02-22T18:50:05.980350+0000 mon.a (mon.0) 704 : cluster [DBG] Standby manager daemon x started 2024-02-22T18:50:06.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:06 smithi111 bash[14162]: audit 2024-02-22T18:50:05.982337+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T18:50:06.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:06 smithi111 bash[14162]: audit 2024-02-22T18:50:05.983417+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:50:06.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:06 smithi111 bash[14162]: audit 2024-02-22T18:50:05.987716+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T18:50:06.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:06 smithi111 bash[14162]: audit 2024-02-22T18:50:05.988744+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:50:07.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:07 smithi111 bash[14162]: cluster 2024-02-22T18:50:06.662872+0000 mon.a (mon.0) 705 : cluster [DBG] mgrmap e16: y(active, since 12m), standbys: x 2024-02-22T18:50:08.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:07 smithi040 bash[13988]: cluster 2024-02-22T18:50:06.662872+0000 mon.a (mon.0) 705 : cluster [DBG] mgrmap e16: y(active, since 12m), standbys: x 2024-02-22T18:50:08.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:07 smithi040 bash[17964]: cluster 2024-02-22T18:50:06.662872+0000 mon.a (mon.0) 705 : cluster [DBG] mgrmap e16: y(active, since 12m), standbys: x 2024-02-22T18:50:08.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:08 smithi111 bash[14162]: cluster 2024-02-22T18:50:06.797463+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v424: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:09.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:08 smithi040 bash[17964]: cluster 2024-02-22T18:50:06.797463+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v424: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:09.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:08 smithi040 bash[13988]: cluster 2024-02-22T18:50:06.797463+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v424: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:10.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:10 smithi111 bash[14162]: cluster 2024-02-22T18:50:08.798803+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v425: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:11.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:10 smithi040 bash[13988]: cluster 2024-02-22T18:50:08.798803+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v425: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:11.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:10 smithi040 bash[17964]: cluster 2024-02-22T18:50:08.798803+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v425: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:12.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:12 smithi111 bash[14162]: cluster 2024-02-22T18:50:10.799816+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v426: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:13.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:12 smithi040 bash[17964]: cluster 2024-02-22T18:50:10.799816+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v426: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:13.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:12 smithi040 bash[13988]: cluster 2024-02-22T18:50:10.799816+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v426: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:14.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:14 smithi111 bash[14162]: cluster 2024-02-22T18:50:12.801147+0000 mgr.y (mgr.14138) 487 : cluster [DBG] pgmap v427: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:15.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:14 smithi040 bash[17964]: cluster 2024-02-22T18:50:12.801147+0000 mgr.y (mgr.14138) 487 : cluster [DBG] pgmap v427: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:15.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:14 smithi040 bash[13988]: cluster 2024-02-22T18:50:12.801147+0000 mgr.y (mgr.14138) 487 : cluster [DBG] pgmap v427: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:16 smithi111 bash[14162]: cluster 2024-02-22T18:50:14.801942+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v428: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:17.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:16 smithi040 bash[17964]: cluster 2024-02-22T18:50:14.801942+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v428: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:17.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:16 smithi040 bash[13988]: cluster 2024-02-22T18:50:14.801942+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v428: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:18.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:18 smithi111 bash[14162]: cluster 2024-02-22T18:50:16.802903+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v429: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:19.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:18 smithi040 bash[13988]: cluster 2024-02-22T18:50:16.802903+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v429: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:19.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:18 smithi040 bash[17964]: cluster 2024-02-22T18:50:16.802903+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v429: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:21.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:20 smithi040 bash[13988]: cluster 2024-02-22T18:50:18.804207+0000 mgr.y (mgr.14138) 490 : cluster [DBG] pgmap v430: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:21.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:20 smithi040 bash[17964]: cluster 2024-02-22T18:50:18.804207+0000 mgr.y (mgr.14138) 490 : cluster [DBG] pgmap v430: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:21.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:20 smithi111 bash[14162]: cluster 2024-02-22T18:50:18.804207+0000 mgr.y (mgr.14138) 490 : cluster [DBG] pgmap v430: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:23.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:22 smithi040 bash[17964]: cluster 2024-02-22T18:50:20.805298+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v431: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:22 smithi040 bash[13988]: cluster 2024-02-22T18:50:20.805298+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v431: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:23.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:22 smithi111 bash[14162]: cluster 2024-02-22T18:50:20.805298+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v431: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:24.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:23 smithi040 bash[13988]: cluster 2024-02-22T18:50:22.806593+0000 mgr.y (mgr.14138) 492 : cluster [DBG] pgmap v432: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:24.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:23 smithi040 bash[17964]: cluster 2024-02-22T18:50:22.806593+0000 mgr.y (mgr.14138) 492 : cluster [DBG] pgmap v432: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:24.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:23 smithi111 bash[14162]: cluster 2024-02-22T18:50:22.806593+0000 mgr.y (mgr.14138) 492 : cluster [DBG] pgmap v432: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:26.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:25 smithi040 bash[13988]: cluster 2024-02-22T18:50:24.807384+0000 mgr.y (mgr.14138) 493 : cluster [DBG] pgmap v433: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:26.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:26 smithi040 bash[17964]: cluster 2024-02-22T18:50:24.807384+0000 mgr.y (mgr.14138) 493 : cluster [DBG] pgmap v433: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:26.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:25 smithi111 bash[14162]: cluster 2024-02-22T18:50:24.807384+0000 mgr.y (mgr.14138) 493 : cluster [DBG] pgmap v433: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:28.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:27 smithi111 bash[14162]: cluster 2024-02-22T18:50:26.808525+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v434: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:28.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:27 smithi040 bash[13988]: cluster 2024-02-22T18:50:26.808525+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v434: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:28.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:27 smithi040 bash[17964]: cluster 2024-02-22T18:50:26.808525+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v434: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:30.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:29 smithi111 bash[14162]: cluster 2024-02-22T18:50:28.809843+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v435: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:30.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:29 smithi040 bash[13988]: cluster 2024-02-22T18:50:28.809843+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v435: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:30.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:29 smithi040 bash[17964]: cluster 2024-02-22T18:50:28.809843+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v435: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:32.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:31 smithi111 bash[14162]: cluster 2024-02-22T18:50:30.810915+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v436: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:32.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:31 smithi040 bash[13988]: cluster 2024-02-22T18:50:30.810915+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v436: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:32.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:31 smithi040 bash[17964]: cluster 2024-02-22T18:50:30.810915+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v436: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:34.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:33 smithi111 bash[14162]: cluster 2024-02-22T18:50:32.812256+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v437: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:34.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:33 smithi040 bash[13988]: cluster 2024-02-22T18:50:32.812256+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v437: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:34.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:33 smithi040 bash[17964]: cluster 2024-02-22T18:50:32.812256+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v437: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:36.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:35 smithi111 bash[14162]: cluster 2024-02-22T18:50:34.813138+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v438: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:36.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:35 smithi040 bash[13988]: cluster 2024-02-22T18:50:34.813138+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v438: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:36.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:35 smithi040 bash[17964]: cluster 2024-02-22T18:50:34.813138+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v438: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:38.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:37 smithi111 bash[14162]: cluster 2024-02-22T18:50:36.814166+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v439: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:38.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:37 smithi040 bash[13988]: cluster 2024-02-22T18:50:36.814166+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v439: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:38.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:37 smithi040 bash[17964]: cluster 2024-02-22T18:50:36.814166+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v439: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:40.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:39 smithi040 bash[13988]: cluster 2024-02-22T18:50:38.815492+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v440: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:40.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:39 smithi040 bash[17964]: cluster 2024-02-22T18:50:38.815492+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v440: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:40.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:39 smithi111 bash[14162]: cluster 2024-02-22T18:50:38.815492+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v440: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:42.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:41 smithi040 bash[13988]: cluster 2024-02-22T18:50:40.816586+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v441: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:42.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:41 smithi040 bash[17964]: cluster 2024-02-22T18:50:40.816586+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v441: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:42.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:41 smithi111 bash[14162]: cluster 2024-02-22T18:50:40.816586+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v441: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:43.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:42 smithi040 bash[17964]: audit 2024-02-22T18:50:42.798669+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:50:43.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:42 smithi040 bash[17964]: audit 2024-02-22T18:50:42.801072+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:50:43.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:42 smithi040 bash[13988]: audit 2024-02-22T18:50:42.798669+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:50:43.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:42 smithi040 bash[13988]: audit 2024-02-22T18:50:42.801072+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:50:43.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:42 smithi111 bash[14162]: audit 2024-02-22T18:50:42.798669+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:50:43.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:42 smithi111 bash[14162]: audit 2024-02-22T18:50:42.801072+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:50:44.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:43 smithi040 bash[13988]: cluster 2024-02-22T18:50:42.817841+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v442: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:44.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:43 smithi040 bash[17964]: cluster 2024-02-22T18:50:42.817841+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v442: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:44.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:43 smithi111 bash[14162]: cluster 2024-02-22T18:50:42.817841+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v442: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:46.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:45 smithi040 bash[13988]: cluster 2024-02-22T18:50:44.818584+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v443: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:46.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:45 smithi040 bash[17964]: cluster 2024-02-22T18:50:44.818584+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v443: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:45 smithi111 bash[14162]: cluster 2024-02-22T18:50:44.818584+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v443: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:48.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:47 smithi040 bash[13988]: cluster 2024-02-22T18:50:46.819633+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v444: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:48.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:47 smithi040 bash[17964]: cluster 2024-02-22T18:50:46.819633+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v444: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:48.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:47 smithi111 bash[14162]: cluster 2024-02-22T18:50:46.819633+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v444: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:50.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:49 smithi040 bash[13988]: cluster 2024-02-22T18:50:48.820999+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v445: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:50.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:49 smithi040 bash[17964]: cluster 2024-02-22T18:50:48.820999+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v445: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:50.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:49 smithi111 bash[14162]: cluster 2024-02-22T18:50:48.820999+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v445: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:52.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:52 smithi040 bash[13988]: cluster 2024-02-22T18:50:50.822034+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v446: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:52.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:52 smithi040 bash[17964]: cluster 2024-02-22T18:50:50.822034+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v446: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:52.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:52 smithi111 bash[14162]: cluster 2024-02-22T18:50:50.822034+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v446: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:54.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:54 smithi040 bash[13988]: cluster 2024-02-22T18:50:52.823273+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v447: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:54.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:54 smithi040 bash[17964]: cluster 2024-02-22T18:50:52.823273+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v447: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:54.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:54 smithi111 bash[14162]: cluster 2024-02-22T18:50:52.823273+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v447: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:50:56.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:56 smithi040 bash[13988]: cluster 2024-02-22T18:50:54.824084+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v448: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:56.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:56 smithi040 bash[17964]: cluster 2024-02-22T18:50:54.824084+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v448: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:56.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:56 smithi111 bash[14162]: cluster 2024-02-22T18:50:54.824084+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v448: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:58.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:50:58 smithi040 bash[13988]: cluster 2024-02-22T18:50:56.825106+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v449: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:58.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:50:58 smithi040 bash[17964]: cluster 2024-02-22T18:50:56.825106+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v449: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:50:58.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:50:58 smithi111 bash[14162]: cluster 2024-02-22T18:50:56.825106+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v449: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:00.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:00 smithi040 bash[13988]: cluster 2024-02-22T18:50:58.826545+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v450: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:00.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:00 smithi040 bash[17964]: cluster 2024-02-22T18:50:58.826545+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v450: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:00.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:00 smithi111 bash[14162]: cluster 2024-02-22T18:50:58.826545+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v450: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:02.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:02 smithi040 bash[13988]: cluster 2024-02-22T18:51:00.827746+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v451: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:02.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:02 smithi040 bash[17964]: cluster 2024-02-22T18:51:00.827746+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v451: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:02.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:02 smithi111 bash[14162]: cluster 2024-02-22T18:51:00.827746+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v451: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:04.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:04 smithi040 bash[13988]: cluster 2024-02-22T18:51:02.829055+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v452: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:04.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:04 smithi040 bash[17964]: cluster 2024-02-22T18:51:02.829055+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v452: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:04.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:04 smithi111 bash[14162]: cluster 2024-02-22T18:51:02.829055+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v452: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:06.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:06 smithi040 bash[13988]: cluster 2024-02-22T18:51:04.829852+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v453: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:06.444 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:06 smithi040 bash[17964]: cluster 2024-02-22T18:51:04.829852+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v453: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:06.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:06 smithi111 bash[14162]: cluster 2024-02-22T18:51:04.829852+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v453: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:08.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:08 smithi040 bash[13988]: cluster 2024-02-22T18:51:06.830911+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v454: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:08.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:08 smithi040 bash[17964]: cluster 2024-02-22T18:51:06.830911+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v454: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:08.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:08 smithi111 bash[14162]: cluster 2024-02-22T18:51:06.830911+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v454: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:10.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:10 smithi040 bash[17964]: cluster 2024-02-22T18:51:08.832241+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v455: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:10.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:10 smithi040 bash[13988]: cluster 2024-02-22T18:51:08.832241+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v455: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:10.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:10 smithi111 bash[14162]: cluster 2024-02-22T18:51:08.832241+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v455: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:12.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:12 smithi040 bash[17964]: cluster 2024-02-22T18:51:10.833290+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v456: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:12.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:12 smithi040 bash[13988]: cluster 2024-02-22T18:51:10.833290+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v456: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:12.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:12 smithi111 bash[14162]: cluster 2024-02-22T18:51:10.833290+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v456: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:14.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:14 smithi040 bash[17964]: cluster 2024-02-22T18:51:12.834572+0000 mgr.y (mgr.14138) 517 : cluster [DBG] pgmap v457: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:14.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:14 smithi040 bash[13988]: cluster 2024-02-22T18:51:12.834572+0000 mgr.y (mgr.14138) 517 : cluster [DBG] pgmap v457: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:14.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:14 smithi111 bash[14162]: cluster 2024-02-22T18:51:12.834572+0000 mgr.y (mgr.14138) 517 : cluster [DBG] pgmap v457: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:16 smithi040 bash[17964]: cluster 2024-02-22T18:51:14.835410+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v458: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:16.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:16 smithi040 bash[13988]: cluster 2024-02-22T18:51:14.835410+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v458: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:16.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:16 smithi111 bash[14162]: cluster 2024-02-22T18:51:14.835410+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v458: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:18.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:18 smithi040 bash[17964]: cluster 2024-02-22T18:51:16.836431+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v459: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:18.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:18 smithi040 bash[13988]: cluster 2024-02-22T18:51:16.836431+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v459: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:18.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:18 smithi111 bash[14162]: cluster 2024-02-22T18:51:16.836431+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v459: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:20.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:20 smithi040 bash[17964]: cluster 2024-02-22T18:51:18.837866+0000 mgr.y (mgr.14138) 520 : cluster [DBG] pgmap v460: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:20.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:20 smithi040 bash[13988]: cluster 2024-02-22T18:51:18.837866+0000 mgr.y (mgr.14138) 520 : cluster [DBG] pgmap v460: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:20.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:20 smithi111 bash[14162]: cluster 2024-02-22T18:51:18.837866+0000 mgr.y (mgr.14138) 520 : cluster [DBG] pgmap v460: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:22.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:22 smithi040 bash[17964]: cluster 2024-02-22T18:51:20.838962+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v461: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:22.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:22 smithi040 bash[13988]: cluster 2024-02-22T18:51:20.838962+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v461: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:22.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:22 smithi111 bash[14162]: cluster 2024-02-22T18:51:20.838962+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v461: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:24 smithi040 bash[13988]: cluster 2024-02-22T18:51:22.840212+0000 mgr.y (mgr.14138) 522 : cluster [DBG] pgmap v462: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:24.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:24 smithi040 bash[17964]: cluster 2024-02-22T18:51:22.840212+0000 mgr.y (mgr.14138) 522 : cluster [DBG] pgmap v462: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:24.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:24 smithi111 bash[14162]: cluster 2024-02-22T18:51:22.840212+0000 mgr.y (mgr.14138) 522 : cluster [DBG] pgmap v462: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:26.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:26 smithi040 bash[13988]: cluster 2024-02-22T18:51:24.841092+0000 mgr.y (mgr.14138) 523 : cluster [DBG] pgmap v463: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:26.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:26 smithi040 bash[17964]: cluster 2024-02-22T18:51:24.841092+0000 mgr.y (mgr.14138) 523 : cluster [DBG] pgmap v463: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:26.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:26 smithi111 bash[14162]: cluster 2024-02-22T18:51:24.841092+0000 mgr.y (mgr.14138) 523 : cluster [DBG] pgmap v463: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:28.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:28 smithi040 bash[13988]: cluster 2024-02-22T18:51:26.842105+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v464: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:28.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:28 smithi040 bash[17964]: cluster 2024-02-22T18:51:26.842105+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v464: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:28.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:28 smithi111 bash[14162]: cluster 2024-02-22T18:51:26.842105+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v464: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:30.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:30 smithi040 bash[13988]: cluster 2024-02-22T18:51:28.843497+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v465: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:30.435 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:30 smithi040 bash[17964]: cluster 2024-02-22T18:51:28.843497+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v465: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:30.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:30 smithi111 bash[14162]: cluster 2024-02-22T18:51:28.843497+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v465: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:32.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:32 smithi040 bash[13988]: cluster 2024-02-22T18:51:30.844720+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v466: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:32.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:32 smithi040 bash[17964]: cluster 2024-02-22T18:51:30.844720+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v466: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:32.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:32 smithi111 bash[14162]: cluster 2024-02-22T18:51:30.844720+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v466: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:34.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:34 smithi040 bash[13988]: cluster 2024-02-22T18:51:32.845918+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v467: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:34.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:34 smithi040 bash[17964]: cluster 2024-02-22T18:51:32.845918+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v467: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:34.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:34 smithi111 bash[14162]: cluster 2024-02-22T18:51:32.845918+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v467: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:36.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:36 smithi040 bash[13988]: cluster 2024-02-22T18:51:34.846726+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v468: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:36.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:36 smithi040 bash[17964]: cluster 2024-02-22T18:51:34.846726+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v468: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:36.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:36 smithi111 bash[14162]: cluster 2024-02-22T18:51:34.846726+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v468: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:38.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:38 smithi040 bash[17964]: cluster 2024-02-22T18:51:36.847738+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v469: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:38.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:38 smithi040 bash[13988]: cluster 2024-02-22T18:51:36.847738+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v469: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:38 smithi111 bash[14162]: cluster 2024-02-22T18:51:36.847738+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v469: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:40.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:40 smithi040 bash[17964]: cluster 2024-02-22T18:51:38.849089+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v470: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:40.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:40 smithi040 bash[13988]: cluster 2024-02-22T18:51:38.849089+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v470: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:40.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:40 smithi111 bash[14162]: cluster 2024-02-22T18:51:38.849089+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v470: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:42.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:42 smithi040 bash[17964]: cluster 2024-02-22T18:51:40.850097+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v471: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:42.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:42 smithi040 bash[13988]: cluster 2024-02-22T18:51:40.850097+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v471: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:42.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:42 smithi111 bash[14162]: cluster 2024-02-22T18:51:40.850097+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v471: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:43.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:43 smithi040 bash[17964]: audit 2024-02-22T18:51:42.811417+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:51:43.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:43 smithi040 bash[17964]: audit 2024-02-22T18:51:42.812008+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:51:43.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:43 smithi040 bash[13988]: audit 2024-02-22T18:51:42.811417+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:51:43.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:43 smithi040 bash[13988]: audit 2024-02-22T18:51:42.812008+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:51:43.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:43 smithi111 bash[14162]: audit 2024-02-22T18:51:42.811417+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:51:43.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:43 smithi111 bash[14162]: audit 2024-02-22T18:51:42.812008+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.14138 172.21.15.40:0/775358367' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:51:44.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:44 smithi040 bash[17964]: cluster 2024-02-22T18:51:42.851334+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v472: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:44.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:44 smithi040 bash[13988]: cluster 2024-02-22T18:51:42.851334+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v472: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:44.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:44 smithi111 bash[14162]: cluster 2024-02-22T18:51:42.851334+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v472: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:46.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:46 smithi040 bash[13988]: cluster 2024-02-22T18:51:44.852148+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v473: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:46.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:46 smithi040 bash[17964]: cluster 2024-02-22T18:51:44.852148+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v473: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:46 smithi111 bash[14162]: cluster 2024-02-22T18:51:44.852148+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v473: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:48.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:48 smithi040 bash[13988]: cluster 2024-02-22T18:51:46.853186+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v474: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:48.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:48 smithi040 bash[17964]: cluster 2024-02-22T18:51:46.853186+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v474: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:48.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:48 smithi111 bash[14162]: cluster 2024-02-22T18:51:46.853186+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v474: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:50.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:50 smithi040 bash[13988]: cluster 2024-02-22T18:51:48.854426+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v475: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:50.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:50 smithi040 bash[17964]: cluster 2024-02-22T18:51:48.854426+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v475: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:50.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:50 smithi111 bash[14162]: cluster 2024-02-22T18:51:48.854426+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v475: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:52.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:52 smithi040 bash[13988]: cluster 2024-02-22T18:51:50.855422+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v476: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:52.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:52 smithi040 bash[17964]: cluster 2024-02-22T18:51:50.855422+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v476: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:52.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:52 smithi111 bash[14162]: cluster 2024-02-22T18:51:50.855422+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v476: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:54.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:54 smithi040 bash[13988]: cluster 2024-02-22T18:51:52.856683+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v477: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:54.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:54 smithi040 bash[17964]: cluster 2024-02-22T18:51:52.856683+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v477: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:54.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:54 smithi111 bash[14162]: cluster 2024-02-22T18:51:52.856683+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v477: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:51:56.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:56 smithi111 bash[14162]: cluster 2024-02-22T18:51:54.857494+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v478: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:56 smithi040 bash[13988]: cluster 2024-02-22T18:51:54.857494+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v478: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:56.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:56 smithi040 bash[17964]: cluster 2024-02-22T18:51:54.857494+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v478: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:58.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:51:58 smithi111 bash[14162]: cluster 2024-02-22T18:51:56.858450+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v479: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:58.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:51:58 smithi040 bash[17964]: cluster 2024-02-22T18:51:56.858450+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v479: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:51:58.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:51:58 smithi040 bash[13988]: cluster 2024-02-22T18:51:56.858450+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v479: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:00.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:00 smithi111 bash[14162]: cluster 2024-02-22T18:51:58.859725+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v480: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:00.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:00 smithi040 bash[17964]: cluster 2024-02-22T18:51:58.859725+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v480: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:00.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:00 smithi040 bash[13988]: cluster 2024-02-22T18:51:58.859725+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v480: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:02.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:02 smithi111 bash[14162]: cluster 2024-02-22T18:52:00.860923+0000 mgr.y (mgr.14138) 541 : cluster [DBG] pgmap v481: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:02.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:02 smithi040 bash[13988]: cluster 2024-02-22T18:52:00.860923+0000 mgr.y (mgr.14138) 541 : cluster [DBG] pgmap v481: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:02 smithi040 bash[17964]: cluster 2024-02-22T18:52:00.860923+0000 mgr.y (mgr.14138) 541 : cluster [DBG] pgmap v481: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:04.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:04 smithi111 bash[14162]: cluster 2024-02-22T18:52:02.862301+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v482: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:04.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:04 smithi040 bash[13988]: cluster 2024-02-22T18:52:02.862301+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v482: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:04.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:04 smithi040 bash[17964]: cluster 2024-02-22T18:52:02.862301+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v482: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:06.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:06 smithi111 bash[14162]: cluster 2024-02-22T18:52:04.863150+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v483: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:06.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:06 smithi040 bash[13988]: cluster 2024-02-22T18:52:04.863150+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v483: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:06.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:06 smithi040 bash[17964]: cluster 2024-02-22T18:52:04.863150+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v483: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:08.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:08 smithi040 bash[13988]: cluster 2024-02-22T18:52:06.864199+0000 mgr.y (mgr.14138) 544 : cluster [DBG] pgmap v484: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:08.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:08 smithi040 bash[17964]: cluster 2024-02-22T18:52:06.864199+0000 mgr.y (mgr.14138) 544 : cluster [DBG] pgmap v484: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:08.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:08 smithi111 bash[14162]: cluster 2024-02-22T18:52:06.864199+0000 mgr.y (mgr.14138) 544 : cluster [DBG] pgmap v484: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:10.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ps' 2024-02-22T18:52:10.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:10 smithi040 bash[13988]: cluster 2024-02-22T18:52:08.865463+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v485: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:10.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:10 smithi040 bash[17964]: cluster 2024-02-22T18:52:08.865463+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v485: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:10.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:10 smithi111 bash[14162]: cluster 2024-02-22T18:52:08.865463+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v485: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:12.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:12 smithi040 bash[13988]: cluster 2024-02-22T18:52:10.866604+0000 mgr.y (mgr.14138) 546 : cluster [DBG] pgmap v486: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:12.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:12 smithi040 bash[17964]: cluster 2024-02-22T18:52:10.866604+0000 mgr.y (mgr.14138) 546 : cluster [DBG] pgmap v486: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:12.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:12 smithi111 bash[14162]: cluster 2024-02-22T18:52:10.866604+0000 mgr.y (mgr.14138) 546 : cluster [DBG] pgmap v486: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:13.238 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (8m) 2m ago 8m 0.20.0 docker.io/prom/alertmanager:v0.20.0 0881eb8f169f d07d332bcae5 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi111 running (8m) 2m ago 8m 6.6.2 docker.io/ceph/ceph-grafana:6.6.2 a0dce381714a 5ee787fea36d 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi.iscsi.a smithi111 running (9m) 2m ago 9m 3.4 docker.io/ceph/ceph:v15.2.9 dfc483079636 06f3942185e1 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi111 running (2m) 2m ago 13m 16.2.14-550-geb66ed92 quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 7403d1862307 a875afad2b64 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 running (15m) 2m ago 15m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 8536cff39497 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (15m) 2m ago 15m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 3c89b7663858 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi111 running (13m) 2m ago 13m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 336462e9a5d0 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (13m) 2m ago 13m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 1f9be7bcd2e0 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (8m) 2m ago 9m 0.18.1 docker.io/prom/node-exporter:v0.18.1 e5a616e4b9cf 3facd7c224ee 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi111 running (9m) 2m ago 9m 0.18.1 docker.io/prom/node-exporter:v0.18.1 e5a616e4b9cf e0f6df3dcf29 2024-02-22T18:52:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (12m) 2m ago 12m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 6caadfc43004 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (12m) 2m ago 12m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 c752ecdf2341 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (11m) 2m ago 11m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 fa43ac3dae85 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (11m) 2m ago 11m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 df5809aeb58e 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi111 running (11m) 2m ago 11m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 88b0bb37dbaf 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi111 running (10m) 2m ago 10m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 0e91fba2eb35 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi111 running (10m) 2m ago 10m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 7bc8f399b295 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi111 running (9m) 2m ago 9m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 59b477b24a62 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi111 running (8m) 2m ago 9m 2.18.1 docker.io/prom/prometheus:v2.18.1 de242295e225 6e001257aec6 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.pyjfss smithi040 running (6m) 2m ago 6m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 47df35fb3739 2024-02-22T18:52:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi111.qafphs smithi111 running (6m) 2m ago 6m 15.2.9 docker.io/ceph/ceph:v15.2.9 dfc483079636 80fcb09b20c7 2024-02-22T18:52:14.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions' 2024-02-22T18:52:14.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:14 smithi040 bash[13988]: cluster 2024-02-22T18:52:12.867968+0000 mgr.y (mgr.14138) 547 : cluster [DBG] pgmap v487: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:14.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:14 smithi111 bash[14162]: cluster 2024-02-22T18:52:12.867968+0000 mgr.y (mgr.14138) 547 : cluster [DBG] pgmap v487: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:14.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:14 smithi111 bash[14162]: audit 2024-02-22T18:52:13.210952+0000 mgr.y (mgr.14138) 548 : audit [DBG] from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:52:14.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:14 smithi040 bash[13988]: audit 2024-02-22T18:52:13.210952+0000 mgr.y (mgr.14138) 548 : audit [DBG] from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:52:14.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:14 smithi040 bash[17964]: cluster 2024-02-22T18:52:12.867968+0000 mgr.y (mgr.14138) 547 : cluster [DBG] pgmap v487: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:14.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:14 smithi040 bash[17964]: audit 2024-02-22T18:52:13.210952+0000 mgr.y (mgr.14138) 548 : audit [DBG] from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:52:16.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:16 smithi040 bash[13988]: cluster 2024-02-22T18:52:14.868913+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v488: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:16.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:16 smithi040 bash[17964]: cluster 2024-02-22T18:52:14.868913+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v488: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:16.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:16 smithi111 bash[14162]: cluster 2024-02-22T18:52:14.868913+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v488: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:17.365 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 3 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 1, 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 8 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-22T18:52:17.366 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 2 2024-02-22T18:52:17.367 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:52:17.367 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-22T18:52:17.367 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 14, 2024-02-22T18:52:17.367 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1 2024-02-22T18:52:17.367 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:52:17.367 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-22T18:52:18.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph -s' 2024-02-22T18:52:18.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:18 smithi040 bash[13988]: cluster 2024-02-22T18:52:16.869995+0000 mgr.y (mgr.14138) 550 : cluster [DBG] pgmap v489: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:18.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:18 smithi040 bash[13988]: audit 2024-02-22T18:52:17.359343+0000 mon.a (mon.0) 710 : audit [DBG] from='client.? 172.21.15.40:0/3183936295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:52:18.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:18 smithi040 bash[17964]: cluster 2024-02-22T18:52:16.869995+0000 mgr.y (mgr.14138) 550 : cluster [DBG] pgmap v489: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:18.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:18 smithi040 bash[17964]: audit 2024-02-22T18:52:17.359343+0000 mon.a (mon.0) 710 : audit [DBG] from='client.? 172.21.15.40:0/3183936295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:52:18.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:18 smithi111 bash[14162]: cluster 2024-02-22T18:52:16.869995+0000 mgr.y (mgr.14138) 550 : cluster [DBG] pgmap v489: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:18.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:18 smithi111 bash[14162]: audit 2024-02-22T18:52:17.359343+0000 mon.a (mon.0) 710 : audit [DBG] from='client.? 172.21.15.40:0/3183936295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:52:20.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:20 smithi040 bash[13988]: cluster 2024-02-22T18:52:18.871270+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v490: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:20.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:20 smithi040 bash[17964]: cluster 2024-02-22T18:52:18.871270+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v490: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:20.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:20 smithi111 bash[14162]: cluster 2024-02-22T18:52:18.871270+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v490: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:21.303 INFO:teuthology.orchestra.run.smithi040.stdout: cluster: 2024-02-22T18:52:21.303 INFO:teuthology.orchestra.run.smithi040.stdout: id: 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: health: HEALTH_OK 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: services: 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: mon: 3 daemons, quorum a,c,b (age 13m) 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: mgr: y(active, since 14m), standbys: x 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: rgw: 2 daemons active (r.z.smithi040.pyjfss, r.z.smithi111.qafphs) 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: task status: 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: data: 2024-02-22T18:52:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: pools: 6 pools, 132 pgs 2024-02-22T18:52:21.305 INFO:teuthology.orchestra.run.smithi040.stdout: objects: 202 objects, 7.4 KiB 2024-02-22T18:52:21.305 INFO:teuthology.orchestra.run.smithi040.stdout: usage: 8.0 GiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:21.305 INFO:teuthology.orchestra.run.smithi040.stdout: pgs: 132 active+clean 2024-02-22T18:52:21.305 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:52:21.305 INFO:teuthology.orchestra.run.smithi040.stdout: io: 2024-02-22T18:52:21.305 INFO:teuthology.orchestra.run.smithi040.stdout: client: 852 B/s rd, 0 op/s rd, 0 op/s wr 2024-02-22T18:52:21.305 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:52:22.041 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 2'"'"'' 2024-02-22T18:52:22.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:22 smithi040 bash[13988]: cluster 2024-02-22T18:52:20.872434+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v491: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:22.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:22 smithi040 bash[13988]: audit 2024-02-22T18:52:21.297283+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.40:0/68064942' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:52:22.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:22 smithi040 bash[17964]: cluster 2024-02-22T18:52:20.872434+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v491: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:22.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:22 smithi040 bash[17964]: audit 2024-02-22T18:52:21.297283+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.40:0/68064942' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:52:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:22 smithi111 bash[14162]: cluster 2024-02-22T18:52:20.872434+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v491: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:22 smithi111 bash[14162]: audit 2024-02-22T18:52:21.297283+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.40:0/68064942' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:52:24.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:24 smithi040 bash[13988]: cluster 2024-02-22T18:52:22.873654+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v492: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:24 smithi040 bash[17964]: cluster 2024-02-22T18:52:22.873654+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v492: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:24.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:24 smithi111 bash[14162]: cluster 2024-02-22T18:52:22.873654+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v492: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:25.142 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-22T18:52:25.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:25 smithi040 bash[17964]: audit 2024-02-22T18:52:25.119084+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.40:0/3086033413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:52:25.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:25 smithi040 bash[13988]: audit 2024-02-22T18:52:25.119084+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.40:0/3086033413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:52:25.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:25 smithi111 bash[14162]: audit 2024-02-22T18:52:25.119084+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.40:0/3086033413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:52:25.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph mgr fail' 2024-02-22T18:52:26.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:26 smithi040 bash[13988]: cluster 2024-02-22T18:52:24.874476+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v493: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:26.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:26 smithi040 bash[17964]: cluster 2024-02-22T18:52:24.874476+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v493: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:26.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:26 smithi111 bash[14162]: cluster 2024-02-22T18:52:24.874476+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v493: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:28.585 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:28 smithi040 bash[13988]: cluster 2024-02-22T18:52:26.875614+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v494: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:28.585 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:28 smithi040 bash[17964]: cluster 2024-02-22T18:52:26.875614+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v494: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:28.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:28 smithi111 bash[14162]: cluster 2024-02-22T18:52:26.875614+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v494: 132 pgs: 132 active+clean; 7.4 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:52:29.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[17964]: audit 2024-02-22T18:52:28.980991+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.40:0/828891976' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T18:52:29.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[17964]: audit 2024-02-22T18:52:28.981441+0000 mon.a (mon.0) 711 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T18:52:29.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[17964]: cluster 2024-02-22T18:52:28.987099+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T18:52:29.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[13988]: audit 2024-02-22T18:52:28.980991+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.40:0/828891976' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T18:52:29.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[13988]: audit 2024-02-22T18:52:28.981441+0000 mon.a (mon.0) 711 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T18:52:29.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[13988]: cluster 2024-02-22T18:52:28.987099+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T18:52:29.683 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[14251]: debug 2024-02-22T18:52:29.286+0000 7f27dd0dc700 -1 mgr handle_mgr_map I was active but no longer am 2024-02-22T18:52:29.683 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[14251]: ignoring --setuser ceph since I am not root 2024-02-22T18:52:29.683 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[14251]: ignoring --setgroup ceph since I am not root 2024-02-22T18:52:29.683 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[14251]: debug 2024-02-22T18:52:29.330+0000 7f2bdc7a0700 1 -- 172.21.15.40:0/3105266793 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556a727d44e0 con 0x556a72834800 2024-02-22T18:52:29.683 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[14251]: debug 2024-02-22T18:52:29.330+0000 7f2bec31b200 1 -- 172.21.15.40:0/3105266793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a72834800 msgr2=0x556a728bb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T18:52:29.683 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:52:29 smithi040 bash[14251]: debug 2024-02-22T18:52:29.330+0000 7f2bec31b200 1 --2- 172.21.15.40:0/3105266793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556a72834800 0x556a728bb400 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x556a72819380 tx=0x556a73412f60).stop 2024-02-22T18:52:29.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:29 smithi111 bash[14162]: audit 2024-02-22T18:52:28.980991+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.40:0/828891976' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T18:52:29.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:29 smithi111 bash[14162]: audit 2024-02-22T18:52:28.981441+0000 mon.a (mon.0) 711 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T18:52:29.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:29 smithi111 bash[14162]: cluster 2024-02-22T18:52:28.987099+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T18:52:30.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'sleep 180' 2024-02-22T18:52:30.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:30 smithi040 bash[17964]: audit 2024-02-22T18:52:29.291898+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-22T18:52:30.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:30 smithi040 bash[17964]: cluster 2024-02-22T18:52:29.292009+0000 mon.a (mon.0) 714 : cluster [DBG] mgrmap e17: x(active, starting, since 0.309932s) 2024-02-22T18:52:30.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:30 smithi040 bash[13988]: audit 2024-02-22T18:52:29.291898+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-22T18:52:30.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:30 smithi040 bash[13988]: cluster 2024-02-22T18:52:29.292009+0000 mon.a (mon.0) 714 : cluster [DBG] mgrmap e17: x(active, starting, since 0.309932s) 2024-02-22T18:52:30.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:30 smithi111 bash[14162]: audit 2024-02-22T18:52:29.291898+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-22T18:52:30.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:30 smithi111 bash[14162]: cluster 2024-02-22T18:52:29.292009+0000 mon.a (mon.0) 714 : cluster [DBG] mgrmap e17: x(active, starting, since 0.309932s) 2024-02-22T18:52:34.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:33 smithi040 bash[17964]: cluster 2024-02-22T18:52:33.827692+0000 mon.a (mon.0) 715 : cluster [DBG] Standby manager daemon y started 2024-02-22T18:52:34.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:33 smithi040 bash[17964]: audit 2024-02-22T18:52:33.829056+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.? 172.21.15.40:0/2871325866' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:52:34.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:33 smithi040 bash[17964]: audit 2024-02-22T18:52:33.831185+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.? 172.21.15.40:0/2871325866' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:52:34.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:33 smithi040 bash[13988]: cluster 2024-02-22T18:52:33.827692+0000 mon.a (mon.0) 715 : cluster [DBG] Standby manager daemon y started 2024-02-22T18:52:34.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:33 smithi040 bash[13988]: audit 2024-02-22T18:52:33.829056+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.? 172.21.15.40:0/2871325866' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:52:34.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:33 smithi040 bash[13988]: audit 2024-02-22T18:52:33.831185+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.? 172.21.15.40:0/2871325866' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:52:34.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:33 smithi111 bash[14162]: cluster 2024-02-22T18:52:33.827692+0000 mon.a (mon.0) 715 : cluster [DBG] Standby manager daemon y started 2024-02-22T18:52:34.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:33 smithi111 bash[14162]: audit 2024-02-22T18:52:33.829056+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.? 172.21.15.40:0/2871325866' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:52:34.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:33 smithi111 bash[14162]: audit 2024-02-22T18:52:33.831185+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.? 172.21.15.40:0/2871325866' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:52:35.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:34 smithi040 bash[13988]: cluster 2024-02-22T18:52:33.887941+0000 mon.a (mon.0) 718 : cluster [DBG] mgrmap e18: x(active, starting, since 4s), standbys: y 2024-02-22T18:52:35.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:34 smithi040 bash[13988]: audit 2024-02-22T18:52:33.896063+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T18:52:35.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:34 smithi040 bash[13988]: audit 2024-02-22T18:52:33.896361+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T18:52:35.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:34 smithi040 bash[17964]: cluster 2024-02-22T18:52:33.887941+0000 mon.a (mon.0) 718 : cluster [DBG] mgrmap e18: x(active, starting, since 4s), standbys: y 2024-02-22T18:52:35.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:34 smithi040 bash[17964]: audit 2024-02-22T18:52:33.896063+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T18:52:35.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:34 smithi040 bash[17964]: audit 2024-02-22T18:52:33.896361+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T18:52:35.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:34 smithi111 bash[14162]: cluster 2024-02-22T18:52:33.887941+0000 mon.a (mon.0) 718 : cluster [DBG] mgrmap e18: x(active, starting, since 4s), standbys: y 2024-02-22T18:52:35.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:34 smithi111 bash[14162]: audit 2024-02-22T18:52:33.896063+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T18:52:35.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:34 smithi111 bash[14162]: audit 2024-02-22T18:52:33.896361+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.? 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T18:52:35.911 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[27054]: Warning: Permanently added 'smithi111,172.21.15.111' (ECDSA) to the list of known hosts. 2024-02-22T18:52:35.911 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[27054]: Warning: Permanently added '172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-22T18:52:36.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.297863+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.298259+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.298647+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.302538+0000 mon.a (mon.0) 722 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.303130+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.303628+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.304141+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.304685+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.305207+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.305721+0000 mon.a (mon.0) 728 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.306223+0000 mon.a (mon.0) 729 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.308465+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.308887+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.310074+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T18:52:36.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.311421+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T18:52:36.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.312995+0000 mon.a (mon.0) 734 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T18:52:36.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.313945+0000 mon.a (mon.0) 735 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T18:52:36.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.314785+0000 mon.a (mon.0) 736 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T18:52:36.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.297863+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T18:52:36.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.298259+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:52:36.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.298647+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:52:36.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.302538+0000 mon.a (mon.0) 722 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.303130+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.303628+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.304141+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.304685+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.305207+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.305721+0000 mon.a (mon.0) 728 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.306223+0000 mon.a (mon.0) 729 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.308465+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.308887+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.310074+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.311421+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.312995+0000 mon.a (mon.0) 734 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.313945+0000 mon.a (mon.0) 735 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.314785+0000 mon.a (mon.0) 736 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T18:52:36.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.315710+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.316665+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.317764+0000 mon.a (mon.0) 739 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.318573+0000 mon.a (mon.0) 740 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.319417+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.320144+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.321149+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.322163+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.323073+0000 mon.a (mon.0) 745 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.323726+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.324451+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.325261+0000 mon.a (mon.0) 748 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.326063+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.326893+0000 mon.a (mon.0) 750 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.327637+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T18:52:36.186 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.328380+0000 mon.a (mon.0) 752 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.315710+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.316665+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.317764+0000 mon.a (mon.0) 739 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.318573+0000 mon.a (mon.0) 740 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.319417+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.320144+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.321149+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.322163+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.323073+0000 mon.a (mon.0) 745 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.323726+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T18:52:36.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.324451+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.325261+0000 mon.a (mon.0) 748 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.326063+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.326893+0000 mon.a (mon.0) 750 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.327637+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.328380+0000 mon.a (mon.0) 752 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.329322+0000 mon.a (mon.0) 753 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.330292+0000 mon.a (mon.0) 754 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.331224+0000 mon.a (mon.0) 755 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.331988+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T18:52:36.188 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.332729+0000 mon.a (mon.0) 757 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: cluster 2024-02-22T18:52:35.351399+0000 mon.a (mon.0) 758 : cluster [INF] Manager daemon x is now available 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: cephadm 2024-02-22T18:52:35.377555+0000 mgr.x (mgr.34751) 1 : cephadm [INF] inventory: adjusted host smithi040 addr 'smithi040' -> '172.21.15.40' 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.385310+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.525115+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.527473+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.607869+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.625212+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.846846+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[17964]: audit 2024-02-22T18:52:35.847586+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.329322+0000 mon.a (mon.0) 753 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.330292+0000 mon.a (mon.0) 754 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T18:52:36.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.331224+0000 mon.a (mon.0) 755 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.331988+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.332729+0000 mon.a (mon.0) 757 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: cluster 2024-02-22T18:52:35.351399+0000 mon.a (mon.0) 758 : cluster [INF] Manager daemon x is now available 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: cephadm 2024-02-22T18:52:35.377555+0000 mgr.x (mgr.34751) 1 : cephadm [INF] inventory: adjusted host smithi040 addr 'smithi040' -> '172.21.15.40' 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.385310+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.525115+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.527473+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.607869+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.625212+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.846846+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:52:36.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:35 smithi040 bash[13988]: audit 2024-02-22T18:52:35.847586+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:52:36.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.297863+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T18:52:36.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.298259+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:52:36.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.298647+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:52:36.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.302538+0000 mon.a (mon.0) 722 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:52:36.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.303130+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.303628+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.304141+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.304685+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.305207+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.305721+0000 mon.a (mon.0) 728 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.306223+0000 mon.a (mon.0) 729 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.308465+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.308887+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.310074+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.311421+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.312995+0000 mon.a (mon.0) 734 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.313945+0000 mon.a (mon.0) 735 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.314785+0000 mon.a (mon.0) 736 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.315710+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.316665+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T18:52:36.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.317764+0000 mon.a (mon.0) 739 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.318573+0000 mon.a (mon.0) 740 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.319417+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.320144+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.321149+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.322163+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.323073+0000 mon.a (mon.0) 745 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.323726+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.324451+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.325261+0000 mon.a (mon.0) 748 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.326063+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.326893+0000 mon.a (mon.0) 750 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.327637+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.328380+0000 mon.a (mon.0) 752 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.329322+0000 mon.a (mon.0) 753 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:52:36.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.330292+0000 mon.a (mon.0) 754 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.331224+0000 mon.a (mon.0) 755 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.331988+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.332729+0000 mon.a (mon.0) 757 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: cluster 2024-02-22T18:52:35.351399+0000 mon.a (mon.0) 758 : cluster [INF] Manager daemon x is now available 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: cephadm 2024-02-22T18:52:35.377555+0000 mgr.x (mgr.34751) 1 : cephadm [INF] inventory: adjusted host smithi040 addr 'smithi040' -> '172.21.15.40' 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.385310+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.525115+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.527473+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.607869+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.625212+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.846846+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:52:36.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:35 smithi111 bash[14162]: audit 2024-02-22T18:52:35.847586+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:52:37.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:36 smithi040 bash[13988]: cluster 2024-02-22T18:52:35.927899+0000 mon.a (mon.0) 766 : cluster [DBG] mgrmap e19: x(active, since 6s), standbys: y 2024-02-22T18:52:37.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:36 smithi040 bash[13988]: cluster 2024-02-22T18:52:35.970593+0000 mgr.x (mgr.34751) 2 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:37.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:36 smithi040 bash[17964]: cluster 2024-02-22T18:52:35.927899+0000 mon.a (mon.0) 766 : cluster [DBG] mgrmap e19: x(active, since 6s), standbys: y 2024-02-22T18:52:37.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:36 smithi040 bash[17964]: cluster 2024-02-22T18:52:35.970593+0000 mgr.x (mgr.34751) 2 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:37.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:36 smithi111 bash[14162]: cluster 2024-02-22T18:52:35.927899+0000 mon.a (mon.0) 766 : cluster [DBG] mgrmap e19: x(active, since 6s), standbys: y 2024-02-22T18:52:37.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:36 smithi111 bash[14162]: cluster 2024-02-22T18:52:35.970593+0000 mgr.x (mgr.34751) 2 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:38.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:37 smithi040 bash[13988]: cluster 2024-02-22T18:52:37.310132+0000 mgr.x (mgr.34751) 3 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:38.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:37 smithi040 bash[17964]: cluster 2024-02-22T18:52:37.310132+0000 mgr.x (mgr.34751) 3 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:37 smithi111 bash[14162]: cluster 2024-02-22T18:52:37.310132+0000 mgr.x (mgr.34751) 3 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:39.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:38 smithi040 bash[13988]: cluster 2024-02-22T18:52:37.984595+0000 mon.a (mon.0) 767 : cluster [DBG] mgrmap e20: x(active, since 9s), standbys: y 2024-02-22T18:52:39.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:38 smithi040 bash[17964]: cluster 2024-02-22T18:52:37.984595+0000 mon.a (mon.0) 767 : cluster [DBG] mgrmap e20: x(active, since 9s), standbys: y 2024-02-22T18:52:39.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:38 smithi111 bash[14162]: cluster 2024-02-22T18:52:37.984595+0000 mon.a (mon.0) 767 : cluster [DBG] mgrmap e20: x(active, since 9s), standbys: y 2024-02-22T18:52:40.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:39 smithi040 bash[13988]: cluster 2024-02-22T18:52:39.310980+0000 mgr.x (mgr.34751) 4 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:40.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:39 smithi040 bash[17964]: cluster 2024-02-22T18:52:39.310980+0000 mgr.x (mgr.34751) 4 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:40.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:39 smithi111 bash[14162]: cluster 2024-02-22T18:52:39.310980+0000 mgr.x (mgr.34751) 4 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:52:42.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:42 smithi040 bash[13988]: cluster 2024-02-22T18:52:41.312488+0000 mgr.x (mgr.34751) 5 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 958 B/s rd, 0 op/s 2024-02-22T18:52:42.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:42 smithi040 bash[13988]: audit 2024-02-22T18:52:42.278956+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:42 smithi040 bash[17964]: cluster 2024-02-22T18:52:41.312488+0000 mgr.x (mgr.34751) 5 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 958 B/s rd, 0 op/s 2024-02-22T18:52:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:42 smithi040 bash[17964]: audit 2024-02-22T18:52:42.278956+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:42.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:42 smithi111 bash[14162]: cluster 2024-02-22T18:52:41.312488+0000 mgr.x (mgr.34751) 5 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 958 B/s rd, 0 op/s 2024-02-22T18:52:42.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:42 smithi111 bash[14162]: audit 2024-02-22T18:52:42.278956+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.548536+0000 mon.a (mon.0) 769 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.549682+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.550710+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.551685+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.552551+0000 mon.a (mon.0) 773 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.553499+0000 mon.a (mon.0) 774 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.554321+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.555152+0000 mon.a (mon.0) 776 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.556226+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:42.966772+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.218962+0000 mon.a (mon.0) 779 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.220299+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.221675+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.222614+0000 mon.a (mon.0) 782 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.223621+0000 mon.a (mon.0) 783 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.224549+0000 mon.a (mon.0) 784 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.548536+0000 mon.a (mon.0) 769 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.549682+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.550710+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.551685+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.552551+0000 mon.a (mon.0) 773 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.553499+0000 mon.a (mon.0) 774 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.554321+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.555152+0000 mon.a (mon.0) 776 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.556226+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:42.966772+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.218962+0000 mon.a (mon.0) 779 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.220299+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.221675+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.222614+0000 mon.a (mon.0) 782 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.223621+0000 mon.a (mon.0) 783 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.224549+0000 mon.a (mon.0) 784 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.225468+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.226536+0000 mon.a (mon.0) 786 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.227512+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.236609+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.244288+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.250674+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.257009+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.269260+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.290338+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.292793+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth caps", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:52:43.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.299534+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd='[{"prefix": "auth caps", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.318518+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.iscsi.iscsi.a"}]: dispatch 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.320432+0000 mon.a (mon.0) 797 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[13988]: audit 2024-02-22T18:52:43.323201+0000 mon.a (mon.0) 798 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.225468+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.226536+0000 mon.a (mon.0) 786 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.227512+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.236609+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.244288+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.250674+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.257009+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.269260+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.290338+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:52:43.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.292793+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth caps", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:52:43.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.299534+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd='[{"prefix": "auth caps", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-22T18:52:43.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.318518+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.iscsi.iscsi.a"}]: dispatch 2024-02-22T18:52:43.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.320432+0000 mon.a (mon.0) 797 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:52:43.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:43 smithi040 bash[17964]: audit 2024-02-22T18:52:43.323201+0000 mon.a (mon.0) 798 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.548536+0000 mon.a (mon.0) 769 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.549682+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.550710+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.551685+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.552551+0000 mon.a (mon.0) 773 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.553499+0000 mon.a (mon.0) 774 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.554321+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.555152+0000 mon.a (mon.0) 776 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.556226+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:42.966772+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.779 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.218962+0000 mon.a (mon.0) 779 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.220299+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.221675+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.222614+0000 mon.a (mon.0) 782 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.223621+0000 mon.a (mon.0) 783 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.224549+0000 mon.a (mon.0) 784 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.225468+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.226536+0000 mon.a (mon.0) 786 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.227512+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.236609+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.244288+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.250674+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.780 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.257009+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.781 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.269260+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:43.781 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.290338+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:52:43.781 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.292793+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth caps", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:52:43.781 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.299534+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd='[{"prefix": "auth caps", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-22T18:52:43.781 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.318518+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.iscsi.iscsi.a"}]: dispatch 2024-02-22T18:52:43.781 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.320432+0000 mon.a (mon.0) 797 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:52:43.781 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:43 smithi111 bash[14162]: audit 2024-02-22T18:52:43.323201+0000 mon.a (mon.0) 798 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T18:52:44.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:44 smithi111 bash[14162]: cephadm 2024-02-22T18:52:43.290440+0000 mgr.x (mgr.34751) 6 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T18:52:44.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:44 smithi111 bash[14162]: cephadm 2024-02-22T18:52:43.302373+0000 mgr.x (mgr.34751) 7 : cephadm [WRN] Unable to update caps for client.iscsi.iscsi.a 2024-02-22T18:52:44.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:44 smithi111 bash[14162]: cluster 2024-02-22T18:52:43.313018+0000 mgr.x (mgr.34751) 8 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 697 B/s rd, 0 op/s 2024-02-22T18:52:44.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:44 smithi111 bash[14162]: cephadm 2024-02-22T18:52:43.323742+0000 mgr.x (mgr.34751) 9 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T18:52:44.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:44 smithi040 bash[13988]: cephadm 2024-02-22T18:52:43.290440+0000 mgr.x (mgr.34751) 6 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T18:52:44.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:44 smithi040 bash[13988]: cephadm 2024-02-22T18:52:43.302373+0000 mgr.x (mgr.34751) 7 : cephadm [WRN] Unable to update caps for client.iscsi.iscsi.a 2024-02-22T18:52:44.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:44 smithi040 bash[13988]: cluster 2024-02-22T18:52:43.313018+0000 mgr.x (mgr.34751) 8 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 697 B/s rd, 0 op/s 2024-02-22T18:52:44.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:44 smithi040 bash[13988]: cephadm 2024-02-22T18:52:43.323742+0000 mgr.x (mgr.34751) 9 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T18:52:44.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:44 smithi040 bash[17964]: cephadm 2024-02-22T18:52:43.290440+0000 mgr.x (mgr.34751) 6 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T18:52:44.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:44 smithi040 bash[17964]: cephadm 2024-02-22T18:52:43.302373+0000 mgr.x (mgr.34751) 7 : cephadm [WRN] Unable to update caps for client.iscsi.iscsi.a 2024-02-22T18:52:44.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:44 smithi040 bash[17964]: cluster 2024-02-22T18:52:43.313018+0000 mgr.x (mgr.34751) 8 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 697 B/s rd, 0 op/s 2024-02-22T18:52:44.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:44 smithi040 bash[17964]: cephadm 2024-02-22T18:52:43.323742+0000 mgr.x (mgr.34751) 9 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T18:52:45.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 systemd[1]: Stopping Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T18:52:45.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: --- Logging error --- 2024-02-22T18:52:45.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:45.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.send(msg) 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._connect_unixsocket(self.address) 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Call stack: 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._bootstrap_inner() 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.run() 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: logger.info("Started the configuration object watcher") 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Message: 'Started the configuration object watcher' 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Arguments: () 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: --- Logging error --- 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.send(msg) 2024-02-22T18:52:45.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._connect_unixsocket(self.address) 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Call stack: 2024-02-22T18:52:45.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:45.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: main() 2024-02-22T18:52:45.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Arguments: () 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: --- Logging error --- 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.send(msg) 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._connect_unixsocket(self.address) 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Call stack: 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._bootstrap_inner() 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.run() 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T18:52:45.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.interval)) 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Message: 'Checking for config object changes every 1s' 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Arguments: () 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: --- Logging error --- 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.send(msg) 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._connect_unixsocket(self.address) 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Call stack: 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: main() 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2866, in main 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: ceph_gw.define() 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 225, in define 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.logger.info("Reading the configuration object to update local LIO " 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Message: 'Reading the configuration object to update local LIO configuration' 2024-02-22T18:52:45.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Arguments: () 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: --- Logging error --- 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.send(msg) 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._connect_unixsocket(self.address) 2024-02-22T18:52:45.727 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Call stack: 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: main() 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2866, in main 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: ceph_gw.define() 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 236, in define 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: "nothing to define to LIO".format(self.hostname)) 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Message: 'Configuration does not have an entry for this host(smithi111.front.sepia.ceph.com) - nothing to define to LIO' 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Arguments: () 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: --- Logging error --- 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:45.728 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.send(msg) 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._connect_unixsocket(self.address) 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Call stack: 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:45.729 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: main() 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2894, in main 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: ssl_context=context) 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/flask/app.py", line 841, in run 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: run_simple(host, port, self, **options) 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 739, in run_simple 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: inner() 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 701, in inner 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: log_startup(srv.socket) 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 689, in log_startup 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: display_hostname, port, quit_msg) 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/_internal.py", line 87, in _log 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: getattr(_logger, type)(message.rstrip(), *args, **kwargs) 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Message: ' * Running on %s://%s:%d/ %s' 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Arguments: ('http', '[::]', 5000, '(Press CTRL+C to quit)') 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: --- Logging error --- 2024-02-22T18:52:45.730 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.send(msg) 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._connect_unixsocket(self.address) 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Call stack: 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: main() 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2894, in main 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: ssl_context=context) 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/flask/app.py", line 841, in run 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: run_simple(host, port, self, **options) 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 739, in run_simple 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: inner() 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 702, in inner 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: srv.serve_forever() 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 539, in serve_forever 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: HTTPServer.serve_forever(self) 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/socketserver.py", line 236, in serve_forever 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: ready = selector.select(poll_interval) 2024-02-22T18:52:45.732 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/selectors.py", line 376, in select 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: fd_event_list = self._poll.poll(timeout) 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2898, in signal_stop 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: logger.info("Shutdown received") 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Message: 'Shutdown received' 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Arguments: () 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: --- Logging error --- 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.send(msg) 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Traceback (most recent call last): 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self._connect_unixsocket(self.address) 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: self.socket.connect(address) 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Call stack: 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: main() 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2894, in main 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: ssl_context=context) 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/flask/app.py", line 841, in run 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: run_simple(host, port, self, **options) 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 739, in run_simple 2024-02-22T18:52:45.734 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: inner() 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 702, in inner 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: srv.serve_forever() 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 539, in serve_forever 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: HTTPServer.serve_forever(self) 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/socketserver.py", line 236, in serve_forever 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: ready = selector.select(poll_interval) 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib64/python3.6/selectors.py", line 376, in select 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: fd_event_list = self._poll.poll(timeout) 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/bin/rbd-target-api", line 2901, in signal_stop 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: sys.exit(ceph_gw.delete()) 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 311, in delete 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: "host ({})".format(self.hostname)) 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Message: 'No gateway configuration to remove on this host (smithi111.front.sepia.ceph.com)' 2024-02-22T18:52:45.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 bash[22445]: Arguments: () 2024-02-22T18:52:46.378 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:45 smithi111 docker[28395]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a 2024-02-22T18:52:46.378 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:46 smithi111 bash[22429]: (process:1): GLib-GObject-CRITICAL **: 18:52:46.177: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T18:52:46.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:46 smithi040 bash[13988]: cluster 2024-02-22T18:52:45.313756+0000 mgr.x (mgr.34751) 10 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 547 B/s rd, 0 op/s 2024-02-22T18:52:46.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:46 smithi111 bash[14162]: cluster 2024-02-22T18:52:45.313756+0000 mgr.x (mgr.34751) 10 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 547 B/s rd, 0 op/s 2024-02-22T18:52:46.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:46 smithi040 bash[17964]: cluster 2024-02-22T18:52:45.313756+0000 mgr.x (mgr.34751) 10 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 547 B/s rd, 0 op/s 2024-02-22T18:52:46.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:46 smithi111 bash[28433]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T18:52:46.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:46 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Succeeded. 2024-02-22T18:52:46.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:46 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:52:46.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:46 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Found left-over process 22429 (docker) in control group while starting unit. Ignoring. 2024-02-22T18:52:46.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:46 smithi111 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-22T18:52:46.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:46 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:52:48.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:47 smithi040 bash[13988]: audit 2024-02-22T18:52:46.844223+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:48.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:47 smithi040 bash[13988]: cephadm 2024-02-22T18:52:46.847732+0000 mgr.x (mgr.34751) 11 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T18:52:48.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:47 smithi040 bash[13988]: cephadm 2024-02-22T18:52:46.870930+0000 mgr.x (mgr.34751) 12 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi111 2024-02-22T18:52:48.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:47 smithi040 bash[13988]: cluster 2024-02-22T18:52:47.315221+0000 mgr.x (mgr.34751) 13 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 992 B/s rd, 1 op/s 2024-02-22T18:52:48.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:47 smithi040 bash[17964]: audit 2024-02-22T18:52:46.844223+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:48.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:47 smithi040 bash[17964]: cephadm 2024-02-22T18:52:46.847732+0000 mgr.x (mgr.34751) 11 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T18:52:48.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:47 smithi040 bash[17964]: cephadm 2024-02-22T18:52:46.870930+0000 mgr.x (mgr.34751) 12 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi111 2024-02-22T18:52:48.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:47 smithi040 bash[17964]: cluster 2024-02-22T18:52:47.315221+0000 mgr.x (mgr.34751) 13 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 992 B/s rd, 1 op/s 2024-02-22T18:52:48.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:47 smithi111 bash[14162]: audit 2024-02-22T18:52:46.844223+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:52:48.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:47 smithi111 bash[14162]: cephadm 2024-02-22T18:52:46.847732+0000 mgr.x (mgr.34751) 11 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T18:52:48.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:47 smithi111 bash[14162]: cephadm 2024-02-22T18:52:46.870930+0000 mgr.x (mgr.34751) 12 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi111 2024-02-22T18:52:48.217 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:47 smithi111 bash[14162]: cluster 2024-02-22T18:52:47.315221+0000 mgr.x (mgr.34751) 13 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 992 B/s rd, 1 op/s 2024-02-22T18:52:48.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:48 smithi111 bash[28484]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T18:52:49.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:49 smithi040 bash[17964]: audit 2024-02-22T18:52:49.176367+0000 mon.b (mon.2) 31 : audit [DBG] from='client.? 172.21.15.111:0/187661836' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:52:49.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:49 smithi040 bash[13988]: audit 2024-02-22T18:52:49.176367+0000 mon.b (mon.2) 31 : audit [DBG] from='client.? 172.21.15.111:0/187661836' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:52:49.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:49 smithi111 bash[14162]: audit 2024-02-22T18:52:49.176367+0000 mon.b (mon.2) 31 : audit [DBG] from='client.? 172.21.15.111:0/187661836' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:52:50.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:50 smithi040 bash[13988]: cluster 2024-02-22T18:52:49.315873+0000 mgr.x (mgr.34751) 14 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-02-22T18:52:50.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:50 smithi040 bash[17964]: cluster 2024-02-22T18:52:49.315873+0000 mgr.x (mgr.34751) 14 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-02-22T18:52:50.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:50 smithi111 bash[14162]: cluster 2024-02-22T18:52:49.315873+0000 mgr.x (mgr.34751) 14 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-02-22T18:52:52.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:52 smithi040 bash[13988]: cluster 2024-02-22T18:52:51.317451+0000 mgr.x (mgr.34751) 15 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:52.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:52 smithi040 bash[17964]: cluster 2024-02-22T18:52:51.317451+0000 mgr.x (mgr.34751) 15 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:52.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:52 smithi111 bash[14162]: cluster 2024-02-22T18:52:51.317451+0000 mgr.x (mgr.34751) 15 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:54.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:54 smithi040 bash[13988]: cluster 2024-02-22T18:52:53.318238+0000 mgr.x (mgr.34751) 16 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:52:54.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:54 smithi040 bash[17964]: cluster 2024-02-22T18:52:53.318238+0000 mgr.x (mgr.34751) 16 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:52:54.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:54 smithi111 bash[14162]: cluster 2024-02-22T18:52:53.318238+0000 mgr.x (mgr.34751) 16 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:52:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:56 smithi040 bash[13988]: cluster 2024-02-22T18:52:55.318918+0000 mgr.x (mgr.34751) 17 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:52:56.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:56 smithi040 bash[17964]: cluster 2024-02-22T18:52:55.318918+0000 mgr.x (mgr.34751) 17 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:52:56.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:56 smithi111 bash[14162]: cluster 2024-02-22T18:52:55.318918+0000 mgr.x (mgr.34751) 17 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:52:58.375 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:57 smithi111 bash[14162]: cluster 2024-02-22T18:52:57.319947+0000 mgr.x (mgr.34751) 18 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:58.376 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 systemd[1]: Stopping Ceph prometheus.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T18:52:58.376 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=warn ts=2024-02-22T18:52:58.179Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2024-02-22T18:52:58.376 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.179Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2024-02-22T18:52:58.376 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.179Z caller=main.go:561 msg="Stopping notify discovery manager..." 2024-02-22T18:52:58.376 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.179Z caller=main.go:583 msg="Stopping scrape manager..." 2024-02-22T18:52:58.376 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.179Z caller=main.go:543 msg="Scrape discovery manager stopped" 2024-02-22T18:52:58.376 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.179Z caller=main.go:557 msg="Notify discovery manager stopped" 2024-02-22T18:52:58.376 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.180Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2024-02-22T18:52:58.377 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.180Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2024-02-22T18:52:58.377 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.180Z caller=main.go:577 msg="Scrape manager stopped" 2024-02-22T18:52:58.377 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.180Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2024-02-22T18:52:58.377 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.180Z caller=main.go:749 msg="Notifier manager stopped" 2024-02-22T18:52:58.377 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[25036]: level=info ts=2024-02-22T18:52:58.181Z caller=main.go:761 msg="See you next time!" 2024-02-22T18:52:58.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:57 smithi040 bash[13988]: cluster 2024-02-22T18:52:57.319947+0000 mgr.x (mgr.34751) 18 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:58.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:57 smithi040 bash[17964]: cluster 2024-02-22T18:52:57.319947+0000 mgr.x (mgr.34751) 18 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:52:58.924 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 docker[28900]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-prometheus.a 2024-02-22T18:52:58.924 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@prometheus.a.service: Succeeded. 2024-02-22T18:52:58.924 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 systemd[1]: Stopped Ceph prometheus.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:52:58.924 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:52:58 smithi111 systemd[1]: Started Ceph prometheus.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:52:59.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: --- Logging error --- 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.send(msg) 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self._connect_unixsocket(self.address) 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Call stack: 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self._bootstrap_inner() 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.run() 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: logger.info("Started the configuration object watcher") 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Message: 'Started the configuration object watcher' 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Arguments: () 2024-02-22T18:52:59.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: --- Logging error --- 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.send(msg) 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:59.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self._connect_unixsocket(self.address) 2024-02-22T18:52:59.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:59.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Call stack: 2024-02-22T18:52:59.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:59.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: main() 2024-02-22T18:52:59.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Arguments: () 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: --- Logging error --- 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.send(msg) 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:59.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self._connect_unixsocket(self.address) 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Call stack: 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self._bootstrap_inner() 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.run() 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.interval)) 2024-02-22T18:52:59.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Message: 'Checking for config object changes every 1s' 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Arguments: () 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: --- Logging error --- 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.send(msg) 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:59.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self._connect_unixsocket(self.address) 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Call stack: 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: main() 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2866, in main 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: ceph_gw.define() 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 225, in define 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.logger.info("Reading the configuration object to update local LIO " 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Message: 'Reading the configuration object to update local LIO configuration' 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Arguments: () 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: --- Logging error --- 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.send(msg) 2024-02-22T18:52:59.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self._connect_unixsocket(self.address) 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Call stack: 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: main() 2024-02-22T18:52:59.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2866, in main 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: ceph_gw.define() 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 236, in define 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: "nothing to define to LIO".format(self.hostname)) 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Message: 'Configuration does not have an entry for this host(smithi111.front.sepia.ceph.com) - nothing to define to LIO' 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Arguments: () 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: --- Logging error --- 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.send(msg) 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.227 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self._connect_unixsocket(self.address) 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Call stack: 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: main() 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2894, in main 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: ssl_context=context) 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/flask/app.py", line 841, in run 2024-02-22T18:52:59.228 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: run_simple(host, port, self, **options) 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 739, in run_simple 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: inner() 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 701, in inner 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: log_startup(srv.socket) 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 689, in log_startup 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: display_hostname, port, quit_msg) 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/_internal.py", line 87, in _log 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: getattr(_logger, type)(message.rstrip(), *args, **kwargs) 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Message: ' * Running on %s://%s:%d/ %s' 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Arguments: ('http', '[::]', 5000, '(Press CTRL+C to quit)') 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: --- Logging error --- 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: self.socket.send(msg) 2024-02-22T18:52:59.229 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:52:59.230 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:52:58 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:53:00.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.906222+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.910938+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:53:00.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.913336+0000 mgr.x (mgr.34751) 19 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:53:00.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.927030+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.930842+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:53:00.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: cephadm 2024-02-22T18:52:58.931785+0000 mgr.x (mgr.34751) 20 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.111:5000 to Dashboard 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.933059+0000 mgr.x (mgr.34751) 21 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.934578+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.937166+0000 mgr.x (mgr.34751) 22 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.942149+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.952093+0000 mon.a (mon.0) 806 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.954499+0000 mgr.x (mgr.34751) 23 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.955815+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.957947+0000 mgr.x (mgr.34751) 24 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.962768+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: audit 2024-02-22T18:52:58.968418+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:53:00.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[13988]: cluster 2024-02-22T18:52:59.320673+0000 mgr.x (mgr.34751) 25 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.906222+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.910938+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.913336+0000 mgr.x (mgr.34751) 19 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.927030+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.930842+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: cephadm 2024-02-22T18:52:58.931785+0000 mgr.x (mgr.34751) 20 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.111:5000 to Dashboard 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.933059+0000 mgr.x (mgr.34751) 21 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.934578+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.937166+0000 mgr.x (mgr.34751) 22 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.942149+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.952093+0000 mon.a (mon.0) 806 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.954499+0000 mgr.x (mgr.34751) 23 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.955815+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T18:53:00.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.957947+0000 mgr.x (mgr.34751) 24 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T18:53:00.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.962768+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: audit 2024-02-22T18:52:58.968418+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:53:00.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:52:59 smithi040 bash[17964]: cluster 2024-02-22T18:52:59.320673+0000 mgr.x (mgr.34751) 25 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-22T18:53:00.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.029Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-22T18:53:00.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.029Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2024-02-22T18:53:00.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.029Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2024-02-22T18:53:00.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.029Z caller=main.go:339 host_details="(Linux 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 smithi111 (none))" 2024-02-22T18:53:00.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.029Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2024-02-22T18:53:00.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.029Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-22T18:53:00.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.031Z caller=main.go:678 msg="Starting TSDB ..." 2024-02-22T18:53:00.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.031Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.035Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.035Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.050Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.050Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.050Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=15.093485ms 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.053Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.053Z caller=main.go:695 msg="TSDB started" 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.053Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.081Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-22T18:53:00.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 18:53:00 smithi111 bash[28960]: level=info ts=2024-02-22T18:53:00.081Z caller=main.go:646 msg="Server is ready to receive web requests." 2024-02-22T18:53:00.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.906222+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.910938+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:53:00.218 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.913336+0000 mgr.x (mgr.34751) 19 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.927030+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.930842+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: cephadm 2024-02-22T18:52:58.931785+0000 mgr.x (mgr.34751) 20 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.111:5000 to Dashboard 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.933059+0000 mgr.x (mgr.34751) 21 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.934578+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.937166+0000 mgr.x (mgr.34751) 22 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.942149+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.952093+0000 mon.a (mon.0) 806 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.954499+0000 mgr.x (mgr.34751) 23 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.955815+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.957947+0000 mgr.x (mgr.34751) 24 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.962768+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: audit 2024-02-22T18:52:58.968418+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:53:00.219 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:52:59 smithi111 bash[14162]: cluster 2024-02-22T18:52:59.320673+0000 mgr.x (mgr.34751) 25 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-22T18:53:02.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:02 smithi040 bash[13988]: cluster 2024-02-22T18:53:01.322233+0000 mgr.x (mgr.34751) 26 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-22T18:53:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:02 smithi040 bash[17964]: cluster 2024-02-22T18:53:01.322233+0000 mgr.x (mgr.34751) 26 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-22T18:53:02.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:02 smithi111 bash[14162]: cluster 2024-02-22T18:53:01.322233+0000 mgr.x (mgr.34751) 26 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-22T18:53:04.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:04 smithi040 bash[13988]: cluster 2024-02-22T18:53:03.322921+0000 mgr.x (mgr.34751) 27 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:04.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:04 smithi040 bash[17964]: cluster 2024-02-22T18:53:03.322921+0000 mgr.x (mgr.34751) 27 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:04.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:04 smithi111 bash[14162]: cluster 2024-02-22T18:53:03.322921+0000 mgr.x (mgr.34751) 27 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:06.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[13988]: cluster 2024-02-22T18:53:05.323559+0000 mgr.x (mgr.34751) 28 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:06.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[13988]: audit 2024-02-22T18:53:05.690820+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:06.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[13988]: audit 2024-02-22T18:53:05.693027+0000 mon.a (mon.0) 811 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:53:06.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[13988]: audit 2024-02-22T18:53:05.695173+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:53:06.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[13988]: audit 2024-02-22T18:53:05.704892+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:06.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[13988]: audit 2024-02-22T18:53:05.718526+0000 mon.a (mon.0) 814 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:53:06.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[17964]: cluster 2024-02-22T18:53:05.323559+0000 mgr.x (mgr.34751) 28 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:06.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[17964]: audit 2024-02-22T18:53:05.690820+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:06.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[17964]: audit 2024-02-22T18:53:05.693027+0000 mon.a (mon.0) 811 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:53:06.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[17964]: audit 2024-02-22T18:53:05.695173+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:53:06.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[17964]: audit 2024-02-22T18:53:05.704892+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:06.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:06 smithi040 bash[17964]: audit 2024-02-22T18:53:05.718526+0000 mon.a (mon.0) 814 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:53:06.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:06 smithi111 bash[14162]: cluster 2024-02-22T18:53:05.323559+0000 mgr.x (mgr.34751) 28 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:06.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:06 smithi111 bash[14162]: audit 2024-02-22T18:53:05.690820+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:06.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:06 smithi111 bash[14162]: audit 2024-02-22T18:53:05.693027+0000 mon.a (mon.0) 811 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:53:06.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:06 smithi111 bash[14162]: audit 2024-02-22T18:53:05.695173+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:53:06.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:06 smithi111 bash[14162]: audit 2024-02-22T18:53:05.704892+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:06.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:06 smithi111 bash[14162]: audit 2024-02-22T18:53:05.718526+0000 mon.a (mon.0) 814 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:53:07.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:07 smithi040 bash[13988]: cephadm 2024-02-22T18:53:05.698326+0000 mgr.x (mgr.34751) 29 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:53:07.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:07 smithi040 bash[17964]: cephadm 2024-02-22T18:53:05.698326+0000 mgr.x (mgr.34751) 29 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:53:07.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:07 smithi111 bash[14162]: cephadm 2024-02-22T18:53:05.698326+0000 mgr.x (mgr.34751) 29 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:53:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:08 smithi040 bash[13988]: cluster 2024-02-22T18:53:07.325013+0000 mgr.x (mgr.34751) 30 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:08.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:08 smithi040 bash[17964]: cluster 2024-02-22T18:53:07.325013+0000 mgr.x (mgr.34751) 30 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:08.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:08 smithi111 bash[14162]: cluster 2024-02-22T18:53:07.325013+0000 mgr.x (mgr.34751) 30 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:10.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:10 smithi040 bash[17964]: cluster 2024-02-22T18:53:09.325784+0000 mgr.x (mgr.34751) 31 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:10.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:10 smithi040 bash[13988]: cluster 2024-02-22T18:53:09.325784+0000 mgr.x (mgr.34751) 31 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:10.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:10 smithi111 bash[14162]: cluster 2024-02-22T18:53:09.325784+0000 mgr.x (mgr.34751) 31 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:12.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:12 smithi040 bash[13988]: cluster 2024-02-22T18:53:11.327459+0000 mgr.x (mgr.34751) 32 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:12.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:12 smithi040 bash[17964]: cluster 2024-02-22T18:53:11.327459+0000 mgr.x (mgr.34751) 32 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:12.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:12 smithi111 bash[14162]: cluster 2024-02-22T18:53:11.327459+0000 mgr.x (mgr.34751) 32 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:13.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:13 smithi111 bash[14162]: audit 2024-02-22T18:53:12.426494+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:13.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:13 smithi111 bash[14162]: audit 2024-02-22T18:53:12.428091+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:53:13.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:13 smithi111 bash[14162]: audit 2024-02-22T18:53:12.429785+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:53:13.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:13 smithi111 bash[14162]: cephadm 2024-02-22T18:53:12.432501+0000 mgr.x (mgr.34751) 33 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:53:13.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:13 smithi111 bash[14162]: audit 2024-02-22T18:53:12.437250+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:13.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[13988]: audit 2024-02-22T18:53:12.426494+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:13.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[13988]: audit 2024-02-22T18:53:12.428091+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:53:13.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[13988]: audit 2024-02-22T18:53:12.429785+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:53:13.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[13988]: cephadm 2024-02-22T18:53:12.432501+0000 mgr.x (mgr.34751) 33 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:53:13.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[13988]: audit 2024-02-22T18:53:12.437250+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:13.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[17964]: audit 2024-02-22T18:53:12.426494+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:13.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[17964]: audit 2024-02-22T18:53:12.428091+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:53:13.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[17964]: audit 2024-02-22T18:53:12.429785+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:53:13.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[17964]: cephadm 2024-02-22T18:53:12.432501+0000 mgr.x (mgr.34751) 33 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:53:13.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:13 smithi040 bash[17964]: audit 2024-02-22T18:53:12.437250+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:53:14.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:14 smithi111 bash[14162]: cluster 2024-02-22T18:53:13.328396+0000 mgr.x (mgr.34751) 34 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:14.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:14 smithi040 bash[13988]: cluster 2024-02-22T18:53:13.328396+0000 mgr.x (mgr.34751) 34 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:14.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:14 smithi040 bash[17964]: cluster 2024-02-22T18:53:13.328396+0000 mgr.x (mgr.34751) 34 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:16.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:16 smithi111 bash[14162]: cluster 2024-02-22T18:53:15.329272+0000 mgr.x (mgr.34751) 35 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:16.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:16 smithi040 bash[13988]: cluster 2024-02-22T18:53:15.329272+0000 mgr.x (mgr.34751) 35 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:16.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:16 smithi040 bash[17964]: cluster 2024-02-22T18:53:15.329272+0000 mgr.x (mgr.34751) 35 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:18.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:17 smithi040 bash[13988]: cluster 2024-02-22T18:53:17.330838+0000 mgr.x (mgr.34751) 36 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:18.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:17 smithi040 bash[17964]: cluster 2024-02-22T18:53:17.330838+0000 mgr.x (mgr.34751) 36 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:18.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:17 smithi111 bash[14162]: cluster 2024-02-22T18:53:17.330838+0000 mgr.x (mgr.34751) 36 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:20.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:20 smithi040 bash[13988]: cluster 2024-02-22T18:53:19.331634+0000 mgr.x (mgr.34751) 37 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:20.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:20 smithi040 bash[17964]: cluster 2024-02-22T18:53:19.331634+0000 mgr.x (mgr.34751) 37 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:20.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:20 smithi111 bash[14162]: cluster 2024-02-22T18:53:19.331634+0000 mgr.x (mgr.34751) 37 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:22.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:22 smithi040 bash[13988]: cluster 2024-02-22T18:53:21.333085+0000 mgr.x (mgr.34751) 38 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:22.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:22 smithi040 bash[17964]: cluster 2024-02-22T18:53:21.333085+0000 mgr.x (mgr.34751) 38 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:22.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:22 smithi111 bash[14162]: cluster 2024-02-22T18:53:21.333085+0000 mgr.x (mgr.34751) 38 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:24 smithi040 bash[13988]: cluster 2024-02-22T18:53:23.333837+0000 mgr.x (mgr.34751) 39 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:24 smithi040 bash[17964]: cluster 2024-02-22T18:53:23.333837+0000 mgr.x (mgr.34751) 39 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:24.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:24 smithi111 bash[14162]: cluster 2024-02-22T18:53:23.333837+0000 mgr.x (mgr.34751) 39 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:26.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:26 smithi040 bash[13988]: cluster 2024-02-22T18:53:25.334549+0000 mgr.x (mgr.34751) 40 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:26.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:26 smithi040 bash[17964]: cluster 2024-02-22T18:53:25.334549+0000 mgr.x (mgr.34751) 40 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:26.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:26 smithi111 bash[14162]: cluster 2024-02-22T18:53:25.334549+0000 mgr.x (mgr.34751) 40 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:28.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:27 smithi040 bash[13988]: cluster 2024-02-22T18:53:27.336073+0000 mgr.x (mgr.34751) 41 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:28.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:27 smithi040 bash[17964]: cluster 2024-02-22T18:53:27.336073+0000 mgr.x (mgr.34751) 41 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:28.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:27 smithi111 bash[14162]: cluster 2024-02-22T18:53:27.336073+0000 mgr.x (mgr.34751) 41 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:30.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:30 smithi040 bash[17964]: cluster 2024-02-22T18:53:29.336830+0000 mgr.x (mgr.34751) 42 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:30.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:30 smithi040 bash[13988]: cluster 2024-02-22T18:53:29.336830+0000 mgr.x (mgr.34751) 42 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:30.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:30 smithi111 bash[14162]: cluster 2024-02-22T18:53:29.336830+0000 mgr.x (mgr.34751) 42 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:32.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:32 smithi040 bash[13988]: cluster 2024-02-22T18:53:31.338362+0000 mgr.x (mgr.34751) 43 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:32.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:32 smithi040 bash[17964]: cluster 2024-02-22T18:53:31.338362+0000 mgr.x (mgr.34751) 43 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:32.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:32 smithi111 bash[14162]: cluster 2024-02-22T18:53:31.338362+0000 mgr.x (mgr.34751) 43 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:34.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:34 smithi040 bash[13988]: cluster 2024-02-22T18:53:33.339117+0000 mgr.x (mgr.34751) 44 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:34.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:34 smithi040 bash[17964]: cluster 2024-02-22T18:53:33.339117+0000 mgr.x (mgr.34751) 44 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:34.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:34 smithi111 bash[14162]: cluster 2024-02-22T18:53:33.339117+0000 mgr.x (mgr.34751) 44 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:35.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:35 smithi040 bash[13988]: audit 2024-02-22T18:53:35.369161+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T18:53:35.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:35 smithi040 bash[13988]: audit 2024-02-22T18:53:35.369767+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T18:53:35.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:35 smithi040 bash[13988]: audit 2024-02-22T18:53:35.370321+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-22T18:53:35.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:35 smithi040 bash[17964]: audit 2024-02-22T18:53:35.369161+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T18:53:35.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:35 smithi040 bash[17964]: audit 2024-02-22T18:53:35.369767+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T18:53:35.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:35 smithi040 bash[17964]: audit 2024-02-22T18:53:35.370321+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-22T18:53:35.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:35 smithi111 bash[14162]: audit 2024-02-22T18:53:35.369161+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T18:53:35.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:35 smithi111 bash[14162]: audit 2024-02-22T18:53:35.369767+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T18:53:35.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:35 smithi111 bash[14162]: audit 2024-02-22T18:53:35.370321+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-22T18:53:36.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:36 smithi040 bash[13988]: cluster 2024-02-22T18:53:35.339825+0000 mgr.x (mgr.34751) 45 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:36.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:36 smithi040 bash[17964]: cluster 2024-02-22T18:53:35.339825+0000 mgr.x (mgr.34751) 45 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:36.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:36 smithi111 bash[14162]: cluster 2024-02-22T18:53:35.339825+0000 mgr.x (mgr.34751) 45 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:38.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:37 smithi040 bash[13988]: cluster 2024-02-22T18:53:37.341497+0000 mgr.x (mgr.34751) 46 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:38.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:37 smithi040 bash[17964]: cluster 2024-02-22T18:53:37.341497+0000 mgr.x (mgr.34751) 46 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:38.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:37 smithi111 bash[14162]: cluster 2024-02-22T18:53:37.341497+0000 mgr.x (mgr.34751) 46 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:40.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:40 smithi040 bash[13988]: cluster 2024-02-22T18:53:39.342226+0000 mgr.x (mgr.34751) 47 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:40.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:40 smithi040 bash[17964]: cluster 2024-02-22T18:53:39.342226+0000 mgr.x (mgr.34751) 47 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:40.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:40 smithi111 bash[14162]: cluster 2024-02-22T18:53:39.342226+0000 mgr.x (mgr.34751) 47 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:42 smithi040 bash[13988]: cluster 2024-02-22T18:53:41.343781+0000 mgr.x (mgr.34751) 48 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:42 smithi040 bash[17964]: cluster 2024-02-22T18:53:41.343781+0000 mgr.x (mgr.34751) 48 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:42.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:42 smithi111 bash[14162]: cluster 2024-02-22T18:53:41.343781+0000 mgr.x (mgr.34751) 48 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:44.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:44 smithi040 bash[13988]: cluster 2024-02-22T18:53:43.344639+0000 mgr.x (mgr.34751) 49 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:44.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:44 smithi040 bash[17964]: cluster 2024-02-22T18:53:43.344639+0000 mgr.x (mgr.34751) 49 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:44.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:44 smithi111 bash[14162]: cluster 2024-02-22T18:53:43.344639+0000 mgr.x (mgr.34751) 49 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:46.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:46 smithi040 bash[13988]: cluster 2024-02-22T18:53:45.345391+0000 mgr.x (mgr.34751) 50 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:46.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:46 smithi040 bash[17964]: cluster 2024-02-22T18:53:45.345391+0000 mgr.x (mgr.34751) 50 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:46.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:46 smithi111 bash[14162]: cluster 2024-02-22T18:53:45.345391+0000 mgr.x (mgr.34751) 50 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:48.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:47 smithi040 bash[13988]: cluster 2024-02-22T18:53:47.346902+0000 mgr.x (mgr.34751) 51 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:48.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:47 smithi040 bash[17964]: cluster 2024-02-22T18:53:47.346902+0000 mgr.x (mgr.34751) 51 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:48.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:47 smithi111 bash[14162]: cluster 2024-02-22T18:53:47.346902+0000 mgr.x (mgr.34751) 51 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:50.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:50 smithi040 bash[13988]: cluster 2024-02-22T18:53:49.347653+0000 mgr.x (mgr.34751) 52 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:50.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:50 smithi040 bash[17964]: cluster 2024-02-22T18:53:49.347653+0000 mgr.x (mgr.34751) 52 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:50.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:50 smithi111 bash[14162]: cluster 2024-02-22T18:53:49.347653+0000 mgr.x (mgr.34751) 52 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:53:52.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:52 smithi040 bash[13988]: cluster 2024-02-22T18:53:51.349111+0000 mgr.x (mgr.34751) 53 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:52.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:52 smithi040 bash[17964]: cluster 2024-02-22T18:53:51.349111+0000 mgr.x (mgr.34751) 53 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:52.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:52 smithi111 bash[14162]: cluster 2024-02-22T18:53:51.349111+0000 mgr.x (mgr.34751) 53 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:54.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:54 smithi040 bash[13988]: cluster 2024-02-22T18:53:53.349806+0000 mgr.x (mgr.34751) 54 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:53:54.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:54 smithi040 bash[17964]: cluster 2024-02-22T18:53:53.349806+0000 mgr.x (mgr.34751) 54 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:53:54.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:54 smithi111 bash[14162]: cluster 2024-02-22T18:53:53.349806+0000 mgr.x (mgr.34751) 54 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:53:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:56 smithi040 bash[13988]: cluster 2024-02-22T18:53:55.350518+0000 mgr.x (mgr.34751) 55 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:53:56.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:56 smithi040 bash[17964]: cluster 2024-02-22T18:53:55.350518+0000 mgr.x (mgr.34751) 55 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:53:56.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:56 smithi111 bash[14162]: cluster 2024-02-22T18:53:55.350518+0000 mgr.x (mgr.34751) 55 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:53:58.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:53:57 smithi040 bash[13988]: cluster 2024-02-22T18:53:57.352003+0000 mgr.x (mgr.34751) 56 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:58.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:53:57 smithi040 bash[17964]: cluster 2024-02-22T18:53:57.352003+0000 mgr.x (mgr.34751) 56 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:53:58.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:53:57 smithi111 bash[14162]: cluster 2024-02-22T18:53:57.352003+0000 mgr.x (mgr.34751) 56 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:00.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:00 smithi040 bash[13988]: cluster 2024-02-22T18:53:59.352742+0000 mgr.x (mgr.34751) 57 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:54:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:00 smithi040 bash[17964]: cluster 2024-02-22T18:53:59.352742+0000 mgr.x (mgr.34751) 57 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:54:00.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:00 smithi111 bash[14162]: cluster 2024-02-22T18:53:59.352742+0000 mgr.x (mgr.34751) 57 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-22T18:54:02.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:02 smithi040 bash[17964]: cluster 2024-02-22T18:54:01.354273+0000 mgr.x (mgr.34751) 58 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:02 smithi040 bash[13988]: cluster 2024-02-22T18:54:01.354273+0000 mgr.x (mgr.34751) 58 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:02.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:02 smithi111 bash[14162]: cluster 2024-02-22T18:54:01.354273+0000 mgr.x (mgr.34751) 58 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:04.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:04 smithi040 bash[13988]: cluster 2024-02-22T18:54:03.354988+0000 mgr.x (mgr.34751) 59 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:04.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:04 smithi040 bash[17964]: cluster 2024-02-22T18:54:03.354988+0000 mgr.x (mgr.34751) 59 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:04.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:04 smithi111 bash[14162]: cluster 2024-02-22T18:54:03.354988+0000 mgr.x (mgr.34751) 59 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:06.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:06 smithi040 bash[13988]: cluster 2024-02-22T18:54:05.355710+0000 mgr.x (mgr.34751) 60 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:06.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:06 smithi040 bash[17964]: cluster 2024-02-22T18:54:05.355710+0000 mgr.x (mgr.34751) 60 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:06.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:06 smithi111 bash[14162]: cluster 2024-02-22T18:54:05.355710+0000 mgr.x (mgr.34751) 60 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:08.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:07 smithi040 bash[13988]: cluster 2024-02-22T18:54:07.357222+0000 mgr.x (mgr.34751) 61 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:08.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:08 smithi040 bash[17964]: cluster 2024-02-22T18:54:07.357222+0000 mgr.x (mgr.34751) 61 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:08.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:08 smithi111 bash[14162]: cluster 2024-02-22T18:54:07.357222+0000 mgr.x (mgr.34751) 61 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:10.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:10 smithi040 bash[13988]: cluster 2024-02-22T18:54:09.357982+0000 mgr.x (mgr.34751) 62 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:10.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:10 smithi040 bash[17964]: cluster 2024-02-22T18:54:09.357982+0000 mgr.x (mgr.34751) 62 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:10.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:10 smithi111 bash[14162]: cluster 2024-02-22T18:54:09.357982+0000 mgr.x (mgr.34751) 62 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:12.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:12 smithi040 bash[17964]: cluster 2024-02-22T18:54:11.359458+0000 mgr.x (mgr.34751) 63 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:12.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:12 smithi040 bash[13988]: cluster 2024-02-22T18:54:11.359458+0000 mgr.x (mgr.34751) 63 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:12.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:12 smithi111 bash[14162]: cluster 2024-02-22T18:54:11.359458+0000 mgr.x (mgr.34751) 63 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:13.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:13 smithi040 bash[13988]: audit 2024-02-22T18:54:12.746790+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:54:13.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:13 smithi040 bash[13988]: audit 2024-02-22T18:54:12.748620+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:54:13.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:13 smithi040 bash[13988]: audit 2024-02-22T18:54:12.760288+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:54:13.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:13 smithi040 bash[17964]: audit 2024-02-22T18:54:12.746790+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:54:13.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:13 smithi040 bash[17964]: audit 2024-02-22T18:54:12.748620+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:54:13.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:13 smithi040 bash[17964]: audit 2024-02-22T18:54:12.760288+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:54:13.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:13 smithi111 bash[14162]: audit 2024-02-22T18:54:12.746790+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:54:13.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:13 smithi111 bash[14162]: audit 2024-02-22T18:54:12.748620+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:54:13.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:13 smithi111 bash[14162]: audit 2024-02-22T18:54:12.760288+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:54:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:14 smithi111 bash[14162]: cephadm 2024-02-22T18:54:12.751732+0000 mgr.x (mgr.34751) 64 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:54:14.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:14 smithi111 bash[14162]: cluster 2024-02-22T18:54:13.360189+0000 mgr.x (mgr.34751) 65 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:14 smithi040 bash[13988]: cephadm 2024-02-22T18:54:12.751732+0000 mgr.x (mgr.34751) 64 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:54:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:14 smithi040 bash[13988]: cluster 2024-02-22T18:54:13.360189+0000 mgr.x (mgr.34751) 65 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:14.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:14 smithi040 bash[17964]: cephadm 2024-02-22T18:54:12.751732+0000 mgr.x (mgr.34751) 64 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:54:14.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:14 smithi040 bash[17964]: cluster 2024-02-22T18:54:13.360189+0000 mgr.x (mgr.34751) 65 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:16.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:16 smithi111 bash[14162]: cluster 2024-02-22T18:54:15.360901+0000 mgr.x (mgr.34751) 66 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:16.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:16 smithi040 bash[17964]: cluster 2024-02-22T18:54:15.360901+0000 mgr.x (mgr.34751) 66 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:16.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:16 smithi040 bash[13988]: cluster 2024-02-22T18:54:15.360901+0000 mgr.x (mgr.34751) 66 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:18.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:18 smithi040 bash[17964]: cluster 2024-02-22T18:54:17.362522+0000 mgr.x (mgr.34751) 67 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:18.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:18 smithi040 bash[13988]: cluster 2024-02-22T18:54:17.362522+0000 mgr.x (mgr.34751) 67 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:18.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:18 smithi111 bash[14162]: cluster 2024-02-22T18:54:17.362522+0000 mgr.x (mgr.34751) 67 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:20.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:20 smithi040 bash[13988]: cluster 2024-02-22T18:54:19.363269+0000 mgr.x (mgr.34751) 68 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:20.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:20 smithi040 bash[17964]: cluster 2024-02-22T18:54:19.363269+0000 mgr.x (mgr.34751) 68 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:20.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:20 smithi111 bash[14162]: cluster 2024-02-22T18:54:19.363269+0000 mgr.x (mgr.34751) 68 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:22 smithi040 bash[17964]: cluster 2024-02-22T18:54:21.364699+0000 mgr.x (mgr.34751) 69 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:22.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:22 smithi040 bash[13988]: cluster 2024-02-22T18:54:21.364699+0000 mgr.x (mgr.34751) 69 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:22.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:22 smithi111 bash[14162]: cluster 2024-02-22T18:54:21.364699+0000 mgr.x (mgr.34751) 69 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:23.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:54:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:23.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:54:23.932 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:23.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:54:24.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:24 smithi111 bash[14162]: cluster 2024-02-22T18:54:23.365397+0000 mgr.x (mgr.34751) 70 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:24.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:24 smithi040 bash[17964]: cluster 2024-02-22T18:54:23.365397+0000 mgr.x (mgr.34751) 70 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:24.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:24 smithi040 bash[13988]: cluster 2024-02-22T18:54:23.365397+0000 mgr.x (mgr.34751) 70 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:26.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:26 smithi111 bash[14162]: cluster 2024-02-22T18:54:25.366106+0000 mgr.x (mgr.34751) 71 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:26.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:26 smithi040 bash[17964]: cluster 2024-02-22T18:54:25.366106+0000 mgr.x (mgr.34751) 71 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:26.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:26 smithi040 bash[13988]: cluster 2024-02-22T18:54:25.366106+0000 mgr.x (mgr.34751) 71 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:28.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:28 smithi040 bash[17964]: cluster 2024-02-22T18:54:27.367581+0000 mgr.x (mgr.34751) 72 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:28.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:28 smithi040 bash[13988]: cluster 2024-02-22T18:54:27.367581+0000 mgr.x (mgr.34751) 72 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:28.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:28 smithi111 bash[14162]: cluster 2024-02-22T18:54:27.367581+0000 mgr.x (mgr.34751) 72 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:30.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:30 smithi040 bash[17964]: cluster 2024-02-22T18:54:29.368314+0000 mgr.x (mgr.34751) 73 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:30.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:30 smithi040 bash[13988]: cluster 2024-02-22T18:54:29.368314+0000 mgr.x (mgr.34751) 73 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:30.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:30 smithi111 bash[14162]: cluster 2024-02-22T18:54:29.368314+0000 mgr.x (mgr.34751) 73 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:31.625Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:54:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:31.625Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:54:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:31.625Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:54:32.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:32 smithi111 bash[14162]: cluster 2024-02-22T18:54:31.369850+0000 mgr.x (mgr.34751) 74 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:32.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:32 smithi040 bash[17964]: cluster 2024-02-22T18:54:31.369850+0000 mgr.x (mgr.34751) 74 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:32.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:32 smithi040 bash[13988]: cluster 2024-02-22T18:54:31.369850+0000 mgr.x (mgr.34751) 74 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:33.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:33.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:54:33.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:33.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:54:33.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:33.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:54:34.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:34 smithi111 bash[14162]: cluster 2024-02-22T18:54:33.370555+0000 mgr.x (mgr.34751) 75 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:34.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:34 smithi040 bash[17964]: cluster 2024-02-22T18:54:33.370555+0000 mgr.x (mgr.34751) 75 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:34.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:34 smithi040 bash[13988]: cluster 2024-02-22T18:54:33.370555+0000 mgr.x (mgr.34751) 75 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:35.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:35 smithi111 bash[14162]: audit 2024-02-22T18:54:35.377632+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-22T18:54:35.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:35 smithi111 bash[14162]: audit 2024-02-22T18:54:35.378576+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T18:54:35.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:35 smithi111 bash[14162]: audit 2024-02-22T18:54:35.379466+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T18:54:35.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:35 smithi040 bash[13988]: audit 2024-02-22T18:54:35.377632+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-22T18:54:35.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:35 smithi040 bash[13988]: audit 2024-02-22T18:54:35.378576+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T18:54:35.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:35 smithi040 bash[13988]: audit 2024-02-22T18:54:35.379466+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T18:54:35.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:35 smithi040 bash[17964]: audit 2024-02-22T18:54:35.377632+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-22T18:54:35.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:35 smithi040 bash[17964]: audit 2024-02-22T18:54:35.378576+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T18:54:35.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:35 smithi040 bash[17964]: audit 2024-02-22T18:54:35.379466+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T18:54:36.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:36 smithi111 bash[14162]: cluster 2024-02-22T18:54:35.371251+0000 mgr.x (mgr.34751) 76 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:36.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:36 smithi040 bash[13988]: cluster 2024-02-22T18:54:35.371251+0000 mgr.x (mgr.34751) 76 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:36.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:36 smithi040 bash[17964]: cluster 2024-02-22T18:54:35.371251+0000 mgr.x (mgr.34751) 76 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:38.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:38 smithi040 bash[13988]: cluster 2024-02-22T18:54:37.372775+0000 mgr.x (mgr.34751) 77 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:38.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:38 smithi040 bash[17964]: cluster 2024-02-22T18:54:37.372775+0000 mgr.x (mgr.34751) 77 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:38.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:38 smithi111 bash[14162]: cluster 2024-02-22T18:54:37.372775+0000 mgr.x (mgr.34751) 77 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:40.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:40 smithi111 bash[14162]: cluster 2024-02-22T18:54:39.373537+0000 mgr.x (mgr.34751) 78 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:40.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:40 smithi040 bash[17964]: cluster 2024-02-22T18:54:39.373537+0000 mgr.x (mgr.34751) 78 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:40.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:40 smithi040 bash[13988]: cluster 2024-02-22T18:54:39.373537+0000 mgr.x (mgr.34751) 78 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:41.625Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:54:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:41.625Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:54:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:41.626Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:54:42.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:42 smithi111 bash[14162]: cluster 2024-02-22T18:54:41.374971+0000 mgr.x (mgr.34751) 79 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:42.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:42 smithi040 bash[13988]: cluster 2024-02-22T18:54:41.374971+0000 mgr.x (mgr.34751) 79 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:42.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:42 smithi040 bash[17964]: cluster 2024-02-22T18:54:41.374971+0000 mgr.x (mgr.34751) 79 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:43.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:43.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:54:43.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:43.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:54:43.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:43.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:54:44.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:44 smithi111 bash[14162]: cluster 2024-02-22T18:54:43.375700+0000 mgr.x (mgr.34751) 80 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:44.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:44 smithi040 bash[13988]: cluster 2024-02-22T18:54:43.375700+0000 mgr.x (mgr.34751) 80 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:44 smithi040 bash[17964]: cluster 2024-02-22T18:54:43.375700+0000 mgr.x (mgr.34751) 80 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:46.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:46 smithi111 bash[14162]: cluster 2024-02-22T18:54:45.376364+0000 mgr.x (mgr.34751) 81 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:46.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:46 smithi040 bash[13988]: cluster 2024-02-22T18:54:45.376364+0000 mgr.x (mgr.34751) 81 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:46.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:46 smithi040 bash[17964]: cluster 2024-02-22T18:54:45.376364+0000 mgr.x (mgr.34751) 81 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:48.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:48 smithi040 bash[13988]: cluster 2024-02-22T18:54:47.377901+0000 mgr.x (mgr.34751) 82 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:48.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:48 smithi040 bash[17964]: cluster 2024-02-22T18:54:47.377901+0000 mgr.x (mgr.34751) 82 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:48.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:48 smithi111 bash[14162]: cluster 2024-02-22T18:54:47.377901+0000 mgr.x (mgr.34751) 82 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:50.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:50 smithi111 bash[14162]: cluster 2024-02-22T18:54:49.378592+0000 mgr.x (mgr.34751) 83 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:50.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:50 smithi040 bash[13988]: cluster 2024-02-22T18:54:49.378592+0000 mgr.x (mgr.34751) 83 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:50.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:50 smithi040 bash[17964]: cluster 2024-02-22T18:54:49.378592+0000 mgr.x (mgr.34751) 83 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:51.626Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:54:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:51.626Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:54:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:51.626Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:54:52.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:52 smithi111 bash[14162]: cluster 2024-02-22T18:54:51.380055+0000 mgr.x (mgr.34751) 84 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:52.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:52 smithi040 bash[13988]: cluster 2024-02-22T18:54:51.380055+0000 mgr.x (mgr.34751) 84 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:52.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:52 smithi040 bash[17964]: cluster 2024-02-22T18:54:51.380055+0000 mgr.x (mgr.34751) 84 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:53.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:53.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:54:53.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:53.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:54:53.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:54:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:54:53.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:54:54.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:54 smithi111 bash[14162]: cluster 2024-02-22T18:54:53.380765+0000 mgr.x (mgr.34751) 85 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:54.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:54 smithi040 bash[13988]: cluster 2024-02-22T18:54:53.380765+0000 mgr.x (mgr.34751) 85 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:54.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:54 smithi040 bash[17964]: cluster 2024-02-22T18:54:53.380765+0000 mgr.x (mgr.34751) 85 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:56.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:56 smithi111 bash[14162]: cluster 2024-02-22T18:54:55.381460+0000 mgr.x (mgr.34751) 86 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:56.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:56 smithi040 bash[13988]: cluster 2024-02-22T18:54:55.381460+0000 mgr.x (mgr.34751) 86 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:56.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:56 smithi040 bash[17964]: cluster 2024-02-22T18:54:55.381460+0000 mgr.x (mgr.34751) 86 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:54:58.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:54:58 smithi040 bash[13988]: cluster 2024-02-22T18:54:57.383043+0000 mgr.x (mgr.34751) 87 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:58.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:54:58 smithi040 bash[17964]: cluster 2024-02-22T18:54:57.383043+0000 mgr.x (mgr.34751) 87 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:54:58.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:54:58 smithi111 bash[14162]: cluster 2024-02-22T18:54:57.383043+0000 mgr.x (mgr.34751) 87 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:00.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:00 smithi111 bash[14162]: cluster 2024-02-22T18:54:59.383894+0000 mgr.x (mgr.34751) 88 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:00.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:00 smithi040 bash[13988]: cluster 2024-02-22T18:54:59.383894+0000 mgr.x (mgr.34751) 88 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:00.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:00 smithi040 bash[17964]: cluster 2024-02-22T18:54:59.383894+0000 mgr.x (mgr.34751) 88 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:01.626Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:01.626Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:01.932 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:01.626Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:55:02.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:02 smithi111 bash[14162]: cluster 2024-02-22T18:55:01.385463+0000 mgr.x (mgr.34751) 89 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:02.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:02 smithi040 bash[13988]: cluster 2024-02-22T18:55:01.385463+0000 mgr.x (mgr.34751) 89 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:02 smithi040 bash[17964]: cluster 2024-02-22T18:55:01.385463+0000 mgr.x (mgr.34751) 89 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:03.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:03.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:03.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:55:04.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:04 smithi111 bash[14162]: cluster 2024-02-22T18:55:03.386186+0000 mgr.x (mgr.34751) 90 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:04.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:04 smithi040 bash[13988]: cluster 2024-02-22T18:55:03.386186+0000 mgr.x (mgr.34751) 90 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:04.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:04 smithi040 bash[17964]: cluster 2024-02-22T18:55:03.386186+0000 mgr.x (mgr.34751) 90 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:06.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:06 smithi111 bash[14162]: cluster 2024-02-22T18:55:05.386876+0000 mgr.x (mgr.34751) 91 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:06.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:06 smithi040 bash[13988]: cluster 2024-02-22T18:55:05.386876+0000 mgr.x (mgr.34751) 91 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:06 smithi040 bash[17964]: cluster 2024-02-22T18:55:05.386876+0000 mgr.x (mgr.34751) 91 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:08.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:08 smithi040 bash[13988]: cluster 2024-02-22T18:55:07.388375+0000 mgr.x (mgr.34751) 92 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:08.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:08 smithi040 bash[17964]: cluster 2024-02-22T18:55:07.388375+0000 mgr.x (mgr.34751) 92 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:08.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:08 smithi111 bash[14162]: cluster 2024-02-22T18:55:07.388375+0000 mgr.x (mgr.34751) 92 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:10.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:10 smithi111 bash[14162]: cluster 2024-02-22T18:55:09.389110+0000 mgr.x (mgr.34751) 93 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:10.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:10 smithi040 bash[17964]: cluster 2024-02-22T18:55:09.389110+0000 mgr.x (mgr.34751) 93 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:10.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:10 smithi040 bash[13988]: cluster 2024-02-22T18:55:09.389110+0000 mgr.x (mgr.34751) 93 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:11.627Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:11.627Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:11.627Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:55:12.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:12 smithi111 bash[14162]: cluster 2024-02-22T18:55:11.390648+0000 mgr.x (mgr.34751) 94 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:12.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:12 smithi040 bash[17964]: cluster 2024-02-22T18:55:11.390648+0000 mgr.x (mgr.34751) 94 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:12.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:12 smithi040 bash[13988]: cluster 2024-02-22T18:55:11.390648+0000 mgr.x (mgr.34751) 94 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:13.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:13 smithi111 bash[14162]: audit 2024-02-22T18:55:13.079549+0000 mon.a (mon.0) 828 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:55:13.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:13 smithi111 bash[14162]: audit 2024-02-22T18:55:13.081618+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:55:13.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:13 smithi111 bash[14162]: audit 2024-02-22T18:55:13.090728+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:55:13.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:13 smithi040 bash[13988]: audit 2024-02-22T18:55:13.079549+0000 mon.a (mon.0) 828 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:55:13.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:13 smithi040 bash[13988]: audit 2024-02-22T18:55:13.081618+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:55:13.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:13 smithi040 bash[13988]: audit 2024-02-22T18:55:13.090728+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:55:13.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:13 smithi040 bash[17964]: audit 2024-02-22T18:55:13.079549+0000 mon.a (mon.0) 828 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:55:13.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:13 smithi040 bash[17964]: audit 2024-02-22T18:55:13.081618+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:55:13.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:13 smithi040 bash[17964]: audit 2024-02-22T18:55:13.090728+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:55:13.932 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:13.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:13.932 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:13.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:13.932 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:13.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:55:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:14 smithi111 bash[14162]: cephadm 2024-02-22T18:55:13.084639+0000 mgr.x (mgr.34751) 95 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:55:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:14 smithi111 bash[14162]: cluster 2024-02-22T18:55:13.391388+0000 mgr.x (mgr.34751) 96 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:14 smithi040 bash[13988]: cephadm 2024-02-22T18:55:13.084639+0000 mgr.x (mgr.34751) 95 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:55:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:14 smithi040 bash[13988]: cluster 2024-02-22T18:55:13.391388+0000 mgr.x (mgr.34751) 96 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:14.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:14 smithi040 bash[17964]: cephadm 2024-02-22T18:55:13.084639+0000 mgr.x (mgr.34751) 95 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:55:14.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:14 smithi040 bash[17964]: cluster 2024-02-22T18:55:13.391388+0000 mgr.x (mgr.34751) 96 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:16.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:16 smithi040 bash[17964]: cluster 2024-02-22T18:55:15.392087+0000 mgr.x (mgr.34751) 97 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:16.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:16 smithi040 bash[13988]: cluster 2024-02-22T18:55:15.392087+0000 mgr.x (mgr.34751) 97 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:16 smithi111 bash[14162]: cluster 2024-02-22T18:55:15.392087+0000 mgr.x (mgr.34751) 97 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:18.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:18 smithi040 bash[13988]: cluster 2024-02-22T18:55:17.393578+0000 mgr.x (mgr.34751) 98 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:18.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:18 smithi040 bash[17964]: cluster 2024-02-22T18:55:17.393578+0000 mgr.x (mgr.34751) 98 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:18.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:18 smithi111 bash[14162]: cluster 2024-02-22T18:55:17.393578+0000 mgr.x (mgr.34751) 98 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:20.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:20 smithi111 bash[14162]: cluster 2024-02-22T18:55:19.394280+0000 mgr.x (mgr.34751) 99 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:20.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:20 smithi040 bash[13988]: cluster 2024-02-22T18:55:19.394280+0000 mgr.x (mgr.34751) 99 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:20.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:20 smithi040 bash[17964]: cluster 2024-02-22T18:55:19.394280+0000 mgr.x (mgr.34751) 99 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:21.627Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:21.627Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:21.627Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:55:22.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:22 smithi111 bash[14162]: cluster 2024-02-22T18:55:21.395723+0000 mgr.x (mgr.34751) 100 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:22.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:22 smithi040 bash[13988]: cluster 2024-02-22T18:55:21.395723+0000 mgr.x (mgr.34751) 100 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:22.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:22 smithi040 bash[17964]: cluster 2024-02-22T18:55:21.395723+0000 mgr.x (mgr.34751) 100 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:23.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:23.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:23.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:55:24.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:24 smithi040 bash[13988]: cluster 2024-02-22T18:55:23.396450+0000 mgr.x (mgr.34751) 101 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:24.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:24 smithi040 bash[17964]: cluster 2024-02-22T18:55:23.396450+0000 mgr.x (mgr.34751) 101 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:24.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:24 smithi111 bash[14162]: cluster 2024-02-22T18:55:23.396450+0000 mgr.x (mgr.34751) 101 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:26.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:26 smithi040 bash[13988]: cluster 2024-02-22T18:55:25.397148+0000 mgr.x (mgr.34751) 102 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:26.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:26 smithi040 bash[17964]: cluster 2024-02-22T18:55:25.397148+0000 mgr.x (mgr.34751) 102 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:26.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:26 smithi111 bash[14162]: cluster 2024-02-22T18:55:25.397148+0000 mgr.x (mgr.34751) 102 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:28.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:28 smithi040 bash[13988]: cluster 2024-02-22T18:55:27.398746+0000 mgr.x (mgr.34751) 103 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:28.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:28 smithi040 bash[17964]: cluster 2024-02-22T18:55:27.398746+0000 mgr.x (mgr.34751) 103 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:28.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:28 smithi111 bash[14162]: cluster 2024-02-22T18:55:27.398746+0000 mgr.x (mgr.34751) 103 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:30.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:30 smithi111 bash[14162]: cluster 2024-02-22T18:55:29.399617+0000 mgr.x (mgr.34751) 104 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:30.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:30 smithi040 bash[13988]: cluster 2024-02-22T18:55:29.399617+0000 mgr.x (mgr.34751) 104 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:30.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:30 smithi040 bash[17964]: cluster 2024-02-22T18:55:29.399617+0000 mgr.x (mgr.34751) 104 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:31.627Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:31.627Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:31.627Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:55:32.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:32 smithi040 bash[13988]: cluster 2024-02-22T18:55:31.401344+0000 mgr.x (mgr.34751) 105 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 47 KiB/s rd, 0 B/s wr, 77 op/s 2024-02-22T18:55:32.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:32 smithi040 bash[17964]: cluster 2024-02-22T18:55:31.401344+0000 mgr.x (mgr.34751) 105 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 47 KiB/s rd, 0 B/s wr, 77 op/s 2024-02-22T18:55:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:32 smithi111 bash[14162]: cluster 2024-02-22T18:55:31.401344+0000 mgr.x (mgr.34751) 105 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 47 KiB/s rd, 0 B/s wr, 77 op/s 2024-02-22T18:55:33.681 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:33.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:33.681 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:33.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:33.681 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:33.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:55:33.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-22T18:55:34.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:34 smithi040 bash[13988]: cluster 2024-02-22T18:55:33.402130+0000 mgr.x (mgr.34751) 106 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 76 op/s 2024-02-22T18:55:34.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:34 smithi040 bash[17964]: cluster 2024-02-22T18:55:33.402130+0000 mgr.x (mgr.34751) 106 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 76 op/s 2024-02-22T18:55:34.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:34 smithi111 bash[14162]: cluster 2024-02-22T18:55:33.402130+0000 mgr.x (mgr.34751) 106 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 76 op/s 2024-02-22T18:55:35.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:35 smithi040 bash[17964]: audit 2024-02-22T18:55:35.386630+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T18:55:35.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:35 smithi040 bash[17964]: audit 2024-02-22T18:55:35.387218+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-22T18:55:35.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:35 smithi040 bash[17964]: audit 2024-02-22T18:55:35.387734+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-22T18:55:35.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:35 smithi040 bash[13988]: audit 2024-02-22T18:55:35.386630+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T18:55:35.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:35 smithi040 bash[13988]: audit 2024-02-22T18:55:35.387218+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-22T18:55:35.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:35 smithi040 bash[13988]: audit 2024-02-22T18:55:35.387734+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-22T18:55:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:35 smithi111 bash[14162]: audit 2024-02-22T18:55:35.386630+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T18:55:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:35 smithi111 bash[14162]: audit 2024-02-22T18:55:35.387218+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-22T18:55:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:35 smithi111 bash[14162]: audit 2024-02-22T18:55:35.387734+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-22T18:55:36.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:36 smithi040 bash[13988]: cluster 2024-02-22T18:55:35.402742+0000 mgr.x (mgr.34751) 107 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 76 op/s 2024-02-22T18:55:36.909 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:36 smithi040 bash[17964]: cluster 2024-02-22T18:55:35.402742+0000 mgr.x (mgr.34751) 107 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 76 op/s 2024-02-22T18:55:36.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:36 smithi111 bash[14162]: cluster 2024-02-22T18:55:35.402742+0000 mgr.x (mgr.34751) 107 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 76 op/s 2024-02-22T18:55:37.725 INFO:teuthology.orchestra.run.smithi040.stdout:Scheduled to redeploy mgr.y on host 'smithi040' 2024-02-22T18:55:38.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: audit 2024-02-22T18:55:37.342430+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.40:0/4222547177' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T18:55:38.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: cluster 2024-02-22T18:55:37.404199+0000 mgr.x (mgr.34751) 108 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: audit 2024-02-22T18:55:37.717914+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: audit 2024-02-22T18:55:37.740091+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: audit 2024-02-22T18:55:37.742105+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: audit 2024-02-22T18:55:37.751628+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: audit 2024-02-22T18:55:37.760295+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: audit 2024-02-22T18:55:37.762276+0000 mon.a (mon.0) 839 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: audit 2024-02-22T18:55:37.763772+0000 mon.a (mon.0) 840 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[13988]: audit 2024-02-22T18:55:37.766216+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: audit 2024-02-22T18:55:37.342430+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.40:0/4222547177' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: cluster 2024-02-22T18:55:37.404199+0000 mgr.x (mgr.34751) 108 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-02-22T18:55:38.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: audit 2024-02-22T18:55:37.717914+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:55:38.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: audit 2024-02-22T18:55:37.740091+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:55:38.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: audit 2024-02-22T18:55:37.742105+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:55:38.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: audit 2024-02-22T18:55:37.751628+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:55:38.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: audit 2024-02-22T18:55:37.760295+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T18:55:38.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: audit 2024-02-22T18:55:37.762276+0000 mon.a (mon.0) 839 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T18:55:38.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: audit 2024-02-22T18:55:37.763772+0000 mon.a (mon.0) 840 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:55:38.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:38 smithi040 bash[17964]: audit 2024-02-22T18:55:37.766216+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-22T18:55:38.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: audit 2024-02-22T18:55:37.342430+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.40:0/4222547177' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T18:55:38.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: cluster 2024-02-22T18:55:37.404199+0000 mgr.x (mgr.34751) 108 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-02-22T18:55:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: audit 2024-02-22T18:55:37.717914+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:55:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: audit 2024-02-22T18:55:37.740091+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:55:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: audit 2024-02-22T18:55:37.742105+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:55:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: audit 2024-02-22T18:55:37.751628+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:55:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: audit 2024-02-22T18:55:37.760295+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T18:55:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: audit 2024-02-22T18:55:37.762276+0000 mon.a (mon.0) 839 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T18:55:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: audit 2024-02-22T18:55:37.763772+0000 mon.a (mon.0) 840 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:55:38.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:38 smithi111 bash[14162]: audit 2024-02-22T18:55:37.766216+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-22T18:55:38.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ps --refresh' 2024-02-22T18:55:39.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:39 smithi040 bash[17964]: audit 2024-02-22T18:55:37.709424+0000 mgr.x (mgr.34751) 109 : audit [DBG] from='client.14913 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:55:39.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:39 smithi040 bash[17964]: cephadm 2024-02-22T18:55:37.721130+0000 mgr.x (mgr.34751) 110 : cephadm [INF] Schedule redeploy daemon mgr.y 2024-02-22T18:55:39.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:39 smithi040 bash[17964]: cephadm 2024-02-22T18:55:37.745282+0000 mgr.x (mgr.34751) 111 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:55:39.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:39 smithi040 bash[17964]: cephadm 2024-02-22T18:55:37.766916+0000 mgr.x (mgr.34751) 112 : cephadm [INF] Deploying daemon mgr.y on smithi040 2024-02-22T18:55:39.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:39 smithi040 bash[13988]: audit 2024-02-22T18:55:37.709424+0000 mgr.x (mgr.34751) 109 : audit [DBG] from='client.14913 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:55:39.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:39 smithi040 bash[13988]: cephadm 2024-02-22T18:55:37.721130+0000 mgr.x (mgr.34751) 110 : cephadm [INF] Schedule redeploy daemon mgr.y 2024-02-22T18:55:39.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:39 smithi040 bash[13988]: cephadm 2024-02-22T18:55:37.745282+0000 mgr.x (mgr.34751) 111 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:55:39.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:39 smithi040 bash[13988]: cephadm 2024-02-22T18:55:37.766916+0000 mgr.x (mgr.34751) 112 : cephadm [INF] Deploying daemon mgr.y on smithi040 2024-02-22T18:55:39.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:39 smithi111 bash[14162]: audit 2024-02-22T18:55:37.709424+0000 mgr.x (mgr.34751) 109 : audit [DBG] from='client.14913 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:55:39.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:39 smithi111 bash[14162]: cephadm 2024-02-22T18:55:37.721130+0000 mgr.x (mgr.34751) 110 : cephadm [INF] Schedule redeploy daemon mgr.y 2024-02-22T18:55:39.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:39 smithi111 bash[14162]: cephadm 2024-02-22T18:55:37.745282+0000 mgr.x (mgr.34751) 111 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:55:39.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:39 smithi111 bash[14162]: cephadm 2024-02-22T18:55:37.766916+0000 mgr.x (mgr.34751) 112 : cephadm [INF] Deploying daemon mgr.y on smithi040 2024-02-22T18:55:40.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:40 smithi040 bash[13988]: cluster 2024-02-22T18:55:39.404985+0000 mgr.x (mgr.34751) 113 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T18:55:40.302 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:40 smithi040 bash[17964]: cluster 2024-02-22T18:55:39.404985+0000 mgr.x (mgr.34751) 113 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T18:55:40.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:40 smithi111 bash[14162]: cluster 2024-02-22T18:55:39.404985+0000 mgr.x (mgr.34751) 113 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T18:55:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:41.628Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:41.628Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:41.628Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:55:42.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:42 smithi040 bash[13988]: cluster 2024-02-22T18:55:41.406451+0000 mgr.x (mgr.34751) 114 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-02-22T18:55:42.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:42 smithi040 bash[17964]: cluster 2024-02-22T18:55:41.406451+0000 mgr.x (mgr.34751) 114 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-02-22T18:55:42.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:42 smithi111 bash[14162]: cluster 2024-02-22T18:55:41.406451+0000 mgr.x (mgr.34751) 114 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-02-22T18:55:43.450 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (11m) 3m ago 12m 9635k - 0.20.0 0881eb8f169f d07d332bcae5 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi111 running (11m) 2m ago 11m 26.6M - 6.6.2 a0dce381714a 5ee787fea36d 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi.iscsi.a smithi111 running (2m) 2m ago 13m 42.0M - 3.4 dfc483079636 224fd81611fa 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi111 running (5m) 2m ago 16m 416M - 16.2.14-550-geb66ed92 7403d1862307 a875afad2b64 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 running (18m) 3m ago 18m 301M - 15.2.9 dfc483079636 8536cff39497 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (18m) 3m ago 18m 60.1M 2048M 15.2.9 dfc483079636 3c89b7663858 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi111 running (16m) 2m ago 16m 53.5M 2048M 15.2.9 dfc483079636 336462e9a5d0 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (17m) 3m ago 17m 49.0M 2048M 15.2.9 dfc483079636 1f9be7bcd2e0 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (12m) 3m ago 12m 11.4M - 0.18.1 e5a616e4b9cf 3facd7c224ee 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi111 running (12m) 2m ago 12m 11.8M - 0.18.1 e5a616e4b9cf e0f6df3dcf29 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (16m) 3m ago 16m 45.2M 4096M 15.2.9 dfc483079636 6caadfc43004 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (15m) 3m ago 15m 44.8M 4096M 15.2.9 dfc483079636 c752ecdf2341 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (15m) 3m ago 15m 41.0M 4096M 15.2.9 dfc483079636 fa43ac3dae85 2024-02-22T18:55:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (14m) 3m ago 14m 46.7M 4096M 15.2.9 dfc483079636 df5809aeb58e 2024-02-22T18:55:43.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi111 running (14m) 2m ago 14m 45.5M 4096M 15.2.9 dfc483079636 88b0bb37dbaf 2024-02-22T18:55:43.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi111 running (14m) 2m ago 14m 42.9M 4096M 15.2.9 dfc483079636 0e91fba2eb35 2024-02-22T18:55:43.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi111 running (13m) 2m ago 13m 42.2M 4096M 15.2.9 dfc483079636 7bc8f399b295 2024-02-22T18:55:43.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi111 running (13m) 2m ago 13m 44.7M 4096M 15.2.9 dfc483079636 59b477b24a62 2024-02-22T18:55:43.452 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi111 running (2m) 2m ago 12m 28.2M - 2.18.1 de242295e225 88a0cc7fd66c 2024-02-22T18:55:43.452 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.pyjfss smithi040 running (10m) 3m ago 10m 49.7M - 15.2.9 dfc483079636 47df35fb3739 2024-02-22T18:55:43.452 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi111.qafphs smithi111 running (10m) 2m ago 10m 49.5M - 15.2.9 dfc483079636 80fcb09b20c7 2024-02-22T18:55:43.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:43.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:43.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:43.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:43.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:43.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:55:43.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.413750+0000 mon.a (mon.0) 842 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T18:55:43.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.415196+0000 mon.a (mon.0) 843 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.416467+0000 mon.a (mon.0) 844 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.417493+0000 mon.a (mon.0) 845 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.418441+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.419517+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.423954+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.424750+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.425719+0000 mon.a (mon.0) 850 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.426532+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[13988]: audit 2024-02-22T18:55:43.427338+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.413750+0000 mon.a (mon.0) 842 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.415196+0000 mon.a (mon.0) 843 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.416467+0000 mon.a (mon.0) 844 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.417493+0000 mon.a (mon.0) 845 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.418441+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.419517+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.423954+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.424750+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.425719+0000 mon.a (mon.0) 850 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.426532+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:43 smithi040 bash[17964]: audit 2024-02-22T18:55:43.427338+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.413750+0000 mon.a (mon.0) 842 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T18:55:43.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.415196+0000 mon.a (mon.0) 843 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T18:55:43.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.416467+0000 mon.a (mon.0) 844 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.417493+0000 mon.a (mon.0) 845 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.418441+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.419517+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.423954+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T18:55:43.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.424750+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.425719+0000 mon.a (mon.0) 850 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.426532+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:43.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:43 smithi111 bash[14162]: audit 2024-02-22T18:55:43.427338+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:55:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:44 smithi040 bash[17964]: cluster 2024-02-22T18:55:43.407203+0000 mgr.x (mgr.34751) 115 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 44 op/s 2024-02-22T18:55:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:44 smithi040 bash[17964]: audit 2024-02-22T18:55:43.409580+0000 mgr.x (mgr.34751) 116 : audit [DBG] from='client.14919 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:55:44.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:44 smithi040 bash[13988]: cluster 2024-02-22T18:55:43.407203+0000 mgr.x (mgr.34751) 115 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 44 op/s 2024-02-22T18:55:44.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:44 smithi040 bash[13988]: audit 2024-02-22T18:55:43.409580+0000 mgr.x (mgr.34751) 116 : audit [DBG] from='client.14919 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:55:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:44 smithi111 bash[14162]: cluster 2024-02-22T18:55:43.407203+0000 mgr.x (mgr.34751) 115 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 44 op/s 2024-02-22T18:55:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:44 smithi111 bash[14162]: audit 2024-02-22T18:55:43.409580+0000 mgr.x (mgr.34751) 116 : audit [DBG] from='client.14919 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:55:46.345 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'sleep 180' 2024-02-22T18:55:46.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:46 smithi040 bash[13988]: cluster 2024-02-22T18:55:45.407907+0000 mgr.x (mgr.34751) 117 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 44 op/s 2024-02-22T18:55:46.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:46 smithi040 bash[17964]: cluster 2024-02-22T18:55:45.407907+0000 mgr.x (mgr.34751) 117 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 44 op/s 2024-02-22T18:55:46.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:46 smithi111 bash[14162]: cluster 2024-02-22T18:55:45.407907+0000 mgr.x (mgr.34751) 117 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 44 op/s 2024-02-22T18:55:48.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:48 smithi040 bash[13988]: cluster 2024-02-22T18:55:47.409417+0000 mgr.x (mgr.34751) 118 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 44 op/s 2024-02-22T18:55:48.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:48 smithi040 bash[17964]: cluster 2024-02-22T18:55:47.409417+0000 mgr.x (mgr.34751) 118 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 44 op/s 2024-02-22T18:55:48.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:48 smithi111 bash[14162]: cluster 2024-02-22T18:55:47.409417+0000 mgr.x (mgr.34751) 118 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 44 op/s 2024-02-22T18:55:50.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:50 smithi040 bash[13988]: cluster 2024-02-22T18:55:49.410191+0000 mgr.x (mgr.34751) 119 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:50.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:50 smithi040 bash[17964]: cluster 2024-02-22T18:55:49.410191+0000 mgr.x (mgr.34751) 119 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:50.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:50 smithi111 bash[14162]: cluster 2024-02-22T18:55:49.410191+0000 mgr.x (mgr.34751) 119 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:51.628Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:51.628Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:51.628Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:55:52.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:52 smithi040 bash[13988]: cluster 2024-02-22T18:55:51.411633+0000 mgr.x (mgr.34751) 120 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:52.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:52 smithi040 bash[17964]: cluster 2024-02-22T18:55:51.411633+0000 mgr.x (mgr.34751) 120 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:52.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:52 smithi111 bash[14162]: cluster 2024-02-22T18:55:51.411633+0000 mgr.x (mgr.34751) 120 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:53.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:53.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:55:53.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:53.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:55:53.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:55:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:55:53.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:55:54.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:54 smithi040 bash[13988]: cluster 2024-02-22T18:55:53.412333+0000 mgr.x (mgr.34751) 121 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:54.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:54 smithi040 bash[17964]: cluster 2024-02-22T18:55:53.412333+0000 mgr.x (mgr.34751) 121 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:54.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:54 smithi111 bash[14162]: cluster 2024-02-22T18:55:53.412333+0000 mgr.x (mgr.34751) 121 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:56.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:56 smithi040 bash[13988]: cluster 2024-02-22T18:55:55.413048+0000 mgr.x (mgr.34751) 122 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:56.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:56 smithi040 bash[17964]: cluster 2024-02-22T18:55:55.413048+0000 mgr.x (mgr.34751) 122 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:56.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:56 smithi111 bash[14162]: cluster 2024-02-22T18:55:55.413048+0000 mgr.x (mgr.34751) 122 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:55:58.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:55:58 smithi040 bash[17964]: cluster 2024-02-22T18:55:57.414506+0000 mgr.x (mgr.34751) 123 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:58.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:55:58 smithi040 bash[13988]: cluster 2024-02-22T18:55:57.414506+0000 mgr.x (mgr.34751) 123 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:55:58.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:55:58 smithi111 bash[14162]: cluster 2024-02-22T18:55:57.414506+0000 mgr.x (mgr.34751) 123 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:00.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:00 smithi040 bash[13988]: cluster 2024-02-22T18:55:59.415323+0000 mgr.x (mgr.34751) 124 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:00.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:00 smithi040 bash[17964]: cluster 2024-02-22T18:55:59.415323+0000 mgr.x (mgr.34751) 124 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:00 smithi111 bash[14162]: cluster 2024-02-22T18:55:59.415323+0000 mgr.x (mgr.34751) 124 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:01.628Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:01.628Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:01.628Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:56:02.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:02 smithi040 bash[13988]: cluster 2024-02-22T18:56:01.416850+0000 mgr.x (mgr.34751) 125 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:02 smithi040 bash[17964]: cluster 2024-02-22T18:56:01.416850+0000 mgr.x (mgr.34751) 125 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:02.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:02 smithi111 bash[14162]: cluster 2024-02-22T18:56:01.416850+0000 mgr.x (mgr.34751) 125 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:03.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:03.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:03.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:56:04.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:04 smithi040 bash[13988]: cluster 2024-02-22T18:56:03.417643+0000 mgr.x (mgr.34751) 126 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:04.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:04 smithi040 bash[17964]: cluster 2024-02-22T18:56:03.417643+0000 mgr.x (mgr.34751) 126 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:04.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:04 smithi111 bash[14162]: cluster 2024-02-22T18:56:03.417643+0000 mgr.x (mgr.34751) 126 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:06 smithi040 bash[17964]: cluster 2024-02-22T18:56:05.418348+0000 mgr.x (mgr.34751) 127 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:06.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:06 smithi040 bash[13988]: cluster 2024-02-22T18:56:05.418348+0000 mgr.x (mgr.34751) 127 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:06.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:06 smithi111 bash[14162]: cluster 2024-02-22T18:56:05.418348+0000 mgr.x (mgr.34751) 127 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:08.435 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:08 smithi040 bash[13988]: cluster 2024-02-22T18:56:07.419827+0000 mgr.x (mgr.34751) 128 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:08.435 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:08 smithi040 bash[17964]: cluster 2024-02-22T18:56:07.419827+0000 mgr.x (mgr.34751) 128 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:08.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:08 smithi111 bash[14162]: cluster 2024-02-22T18:56:07.419827+0000 mgr.x (mgr.34751) 128 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:10.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:10 smithi040 bash[13988]: cluster 2024-02-22T18:56:09.420551+0000 mgr.x (mgr.34751) 129 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:10.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:10 smithi040 bash[17964]: cluster 2024-02-22T18:56:09.420551+0000 mgr.x (mgr.34751) 129 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:10.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:10 smithi111 bash[14162]: cluster 2024-02-22T18:56:09.420551+0000 mgr.x (mgr.34751) 129 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:11.629Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:11.629Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:11.629Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:56:12.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:12 smithi040 bash[13988]: cluster 2024-02-22T18:56:11.422018+0000 mgr.x (mgr.34751) 130 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:12.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:12 smithi040 bash[17964]: cluster 2024-02-22T18:56:11.422018+0000 mgr.x (mgr.34751) 130 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:12.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:12 smithi111 bash[14162]: cluster 2024-02-22T18:56:11.422018+0000 mgr.x (mgr.34751) 130 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:13.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:13.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:13.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:13.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:13.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:13.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:56:14.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:14 smithi040 bash[17964]: cluster 2024-02-22T18:56:13.422672+0000 mgr.x (mgr.34751) 131 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:14 smithi040 bash[13988]: cluster 2024-02-22T18:56:13.422672+0000 mgr.x (mgr.34751) 131 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:14.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:14 smithi111 bash[14162]: cluster 2024-02-22T18:56:13.422672+0000 mgr.x (mgr.34751) 131 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:16.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:16 smithi040 bash[13988]: cluster 2024-02-22T18:56:15.423418+0000 mgr.x (mgr.34751) 132 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:16.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:16 smithi040 bash[17964]: cluster 2024-02-22T18:56:15.423418+0000 mgr.x (mgr.34751) 132 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:16 smithi111 bash[14162]: cluster 2024-02-22T18:56:15.423418+0000 mgr.x (mgr.34751) 132 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:18.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:18 smithi040 bash[17964]: cluster 2024-02-22T18:56:17.425014+0000 mgr.x (mgr.34751) 133 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:18.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:18 smithi040 bash[13988]: cluster 2024-02-22T18:56:17.425014+0000 mgr.x (mgr.34751) 133 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:18.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:18 smithi111 bash[14162]: cluster 2024-02-22T18:56:17.425014+0000 mgr.x (mgr.34751) 133 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:19.431 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:19 smithi040 systemd[1]: Stopping Ceph mgr.y for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T18:56:20.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:20 smithi040 bash[13988]: cluster 2024-02-22T18:56:19.425793+0000 mgr.x (mgr.34751) 134 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:20.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:20 smithi040 bash[17964]: cluster 2024-02-22T18:56:19.425793+0000 mgr.x (mgr.34751) 134 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:20.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:20 smithi111 bash[14162]: cluster 2024-02-22T18:56:19.425793+0000 mgr.x (mgr.34751) 134 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:21.629Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:21.629Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:21.629Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:56:22.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:22 smithi040 bash[13988]: cluster 2024-02-22T18:56:21.427391+0000 mgr.x (mgr.34751) 135 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:22.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:22 smithi040 bash[17964]: cluster 2024-02-22T18:56:21.427391+0000 mgr.x (mgr.34751) 135 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:22.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:22 smithi111 bash[14162]: cluster 2024-02-22T18:56:21.427391+0000 mgr.x (mgr.34751) 135 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:23.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:23.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:23.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:56:24.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:24 smithi040 bash[13988]: cluster 2024-02-22T18:56:23.428179+0000 mgr.x (mgr.34751) 136 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:24.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:24 smithi040 bash[17964]: cluster 2024-02-22T18:56:23.428179+0000 mgr.x (mgr.34751) 136 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:24.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:24 smithi111 bash[14162]: cluster 2024-02-22T18:56:23.428179+0000 mgr.x (mgr.34751) 136 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:26.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:26 smithi040 bash[13988]: cluster 2024-02-22T18:56:25.428853+0000 mgr.x (mgr.34751) 137 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:26.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:26 smithi040 bash[17964]: cluster 2024-02-22T18:56:25.428853+0000 mgr.x (mgr.34751) 137 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:26.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:26 smithi111 bash[14162]: cluster 2024-02-22T18:56:25.428853+0000 mgr.x (mgr.34751) 137 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:28.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:28 smithi040 bash[13988]: cluster 2024-02-22T18:56:27.430384+0000 mgr.x (mgr.34751) 138 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:28.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:28 smithi040 bash[17964]: cluster 2024-02-22T18:56:27.430384+0000 mgr.x (mgr.34751) 138 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:28.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:28 smithi111 bash[14162]: cluster 2024-02-22T18:56:27.430384+0000 mgr.x (mgr.34751) 138 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:30.362 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:30 smithi040 bash[39574]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-mgr.y 2024-02-22T18:56:30.362 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:30 smithi040 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y.service: Main process exited, code=exited, status=137/n/a 2024-02-22T18:56:30.362 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:30 smithi040 bash[39635]: Error response from daemon: No such container: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-mgr.y 2024-02-22T18:56:30.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:30 smithi040 bash[13988]: cluster 2024-02-22T18:56:29.431111+0000 mgr.x (mgr.34751) 139 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:30.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:30 smithi040 bash[17964]: cluster 2024-02-22T18:56:29.431111+0000 mgr.x (mgr.34751) 139 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:30.681 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:30 smithi040 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y.service: Failed with result 'exit-code'. 2024-02-22T18:56:30.681 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:30 smithi040 systemd[1]: Stopped Ceph mgr.y for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:56:30.681 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:30 smithi040 systemd[1]: Started Ceph mgr.y for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:56:30.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:30 smithi111 bash[14162]: cluster 2024-02-22T18:56:29.431111+0000 mgr.x (mgr.34751) 139 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:31.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[13988]: audit 2024-02-22T18:56:30.686526+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:31.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[13988]: audit 2024-02-22T18:56:30.697719+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:31.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[13988]: audit 2024-02-22T18:56:30.707513+0000 mon.a (mon.0) 855 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:56:31.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[13988]: audit 2024-02-22T18:56:30.708056+0000 mon.a (mon.0) 856 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:56:31.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[13988]: cluster 2024-02-22T18:56:31.432785+0000 mgr.x (mgr.34751) 140 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:31.931 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[39752]: debug 2024-02-22T18:56:31.775+0000 7fecf32dd700 1 -- 172.21.15.40:0/3429634821 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559297cd44e0 con 0x559297dc9000 2024-02-22T18:56:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:31.630Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:31.630Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:31.932 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:31.630Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:56:31.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[17964]: audit 2024-02-22T18:56:30.686526+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:31.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[17964]: audit 2024-02-22T18:56:30.697719+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:31.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[17964]: audit 2024-02-22T18:56:30.707513+0000 mon.a (mon.0) 855 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:56:31.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[17964]: audit 2024-02-22T18:56:30.708056+0000 mon.a (mon.0) 856 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:56:31.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[17964]: cluster 2024-02-22T18:56:31.432785+0000 mgr.x (mgr.34751) 140 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:31.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:31 smithi111 bash[14162]: audit 2024-02-22T18:56:30.686526+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:31.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:31 smithi111 bash[14162]: audit 2024-02-22T18:56:30.697719+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:31.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:31 smithi111 bash[14162]: audit 2024-02-22T18:56:30.707513+0000 mon.a (mon.0) 855 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:56:31.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:31 smithi111 bash[14162]: audit 2024-02-22T18:56:30.708056+0000 mon.a (mon.0) 856 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:56:31.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:31 smithi111 bash[14162]: cluster 2024-02-22T18:56:31.432785+0000 mgr.x (mgr.34751) 140 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:32.430 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:31 smithi040 bash[39752]: debug 2024-02-22T18:56:31.947+0000 7fed038d8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T18:56:32.431 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:32 smithi040 bash[39752]: debug 2024-02-22T18:56:32.051+0000 7fed038d8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T18:56:32.931 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:32 smithi040 bash[39752]: debug 2024-02-22T18:56:32.511+0000 7fed038d8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T18:56:33.829 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:33 smithi040 bash[39752]: debug 2024-02-22T18:56:33.463+0000 7fed038d8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T18:56:33.830 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:33 smithi040 bash[39752]: debug 2024-02-22T18:56:33.563+0000 7fed038d8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T18:56:33.830 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:33 smithi040 bash[39752]: debug 2024-02-22T18:56:33.823+0000 7fed038d8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T18:56:33.830 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:33.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T18:56:33.830 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:33.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:33.830 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:33.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused" 2024-02-22T18:56:34.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:34 smithi040 bash[13988]: cluster 2024-02-22T18:56:33.433501+0000 mgr.x (mgr.34751) 141 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:34.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:34 smithi040 bash[17964]: cluster 2024-02-22T18:56:33.433501+0000 mgr.x (mgr.34751) 141 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:34.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:34 smithi111 bash[14162]: cluster 2024-02-22T18:56:33.433501+0000 mgr.x (mgr.34751) 141 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:35.265 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:34 smithi040 bash[39752]: debug 2024-02-22T18:56:34.987+0000 7fed038d8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T18:56:35.265 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[39752]: debug 2024-02-22T18:56:35.155+0000 7fed038d8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T18:56:35.612 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[13988]: audit 2024-02-22T18:56:35.395399+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-22T18:56:35.612 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[13988]: audit 2024-02-22T18:56:35.396098+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-22T18:56:35.612 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[13988]: audit 2024-02-22T18:56:35.396696+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2024-02-22T18:56:35.613 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[39752]: debug 2024-02-22T18:56:35.259+0000 7fed038d8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T18:56:35.613 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[39752]: debug 2024-02-22T18:56:35.375+0000 7fed038d8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T18:56:35.613 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[17964]: audit 2024-02-22T18:56:35.395399+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-22T18:56:35.613 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[17964]: audit 2024-02-22T18:56:35.396098+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-22T18:56:35.613 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[17964]: audit 2024-02-22T18:56:35.396696+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2024-02-22T18:56:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:35 smithi111 bash[14162]: audit 2024-02-22T18:56:35.395399+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-22T18:56:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:35 smithi111 bash[14162]: audit 2024-02-22T18:56:35.396098+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-22T18:56:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:35 smithi111 bash[14162]: audit 2024-02-22T18:56:35.396696+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2024-02-22T18:56:36.430 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:35 smithi040 bash[39752]: debug 2024-02-22T18:56:35.603+0000 7fed038d8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T18:56:36.431 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:36 smithi040 bash[39752]: debug 2024-02-22T18:56:36.003+0000 7fed038d8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T18:56:36.431 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:36 smithi040 bash[39752]: debug 2024-02-22T18:56:36.127+0000 7fed038d8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T18:56:36.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:36 smithi040 bash[13988]: cluster 2024-02-22T18:56:35.434182+0000 mgr.x (mgr.34751) 142 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:36.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:36 smithi040 bash[17964]: cluster 2024-02-22T18:56:35.434182+0000 mgr.x (mgr.34751) 142 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:36.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:36 smithi111 bash[14162]: cluster 2024-02-22T18:56:35.434182+0000 mgr.x (mgr.34751) 142 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:37.430 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[39752]: debug 2024-02-22T18:56:37.075+0000 7fed038d8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T18:56:37.431 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[39752]: debug 2024-02-22T18:56:37.179+0000 7fed038d8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T18:56:37.431 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[39752]: debug 2024-02-22T18:56:37.303+0000 7fed038d8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T18:56:37.800 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[39752]: debug 2024-02-22T18:56:37.535+0000 7fed038d8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T18:56:38.180 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[39752]: debug 2024-02-22T18:56:37.831+0000 7fed038d8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T18:56:38.181 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:38 smithi040 bash[39752]: debug 2024-02-22T18:56:37.999+0000 7fed038d8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T18:56:38.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[17964]: audit 2024-02-22T18:56:36.793341+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:38.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[17964]: audit 2024-02-22T18:56:37.393492+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:38.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[17964]: cluster 2024-02-22T18:56:37.435667+0000 mgr.x (mgr.34751) 143 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:38.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[17964]: audit 2024-02-22T18:56:37.655493+0000 mon.a (mon.0) 862 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:56:38.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[17964]: audit 2024-02-22T18:56:37.657406+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:56:38.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[17964]: audit 2024-02-22T18:56:37.666180+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:38.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[13988]: audit 2024-02-22T18:56:36.793341+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[13988]: audit 2024-02-22T18:56:37.393492+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[13988]: cluster 2024-02-22T18:56:37.435667+0000 mgr.x (mgr.34751) 143 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[13988]: audit 2024-02-22T18:56:37.655493+0000 mon.a (mon.0) 862 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:56:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[13988]: audit 2024-02-22T18:56:37.657406+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:56:38.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:37 smithi040 bash[13988]: audit 2024-02-22T18:56:37.666180+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:38.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:37 smithi111 bash[14162]: audit 2024-02-22T18:56:36.793341+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:38.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:37 smithi111 bash[14162]: audit 2024-02-22T18:56:37.393492+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:38.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:37 smithi111 bash[14162]: cluster 2024-02-22T18:56:37.435667+0000 mgr.x (mgr.34751) 143 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:38.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:37 smithi111 bash[14162]: audit 2024-02-22T18:56:37.655493+0000 mon.a (mon.0) 862 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:56:38.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:37 smithi111 bash[14162]: audit 2024-02-22T18:56:37.657406+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:56:38.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:37 smithi111 bash[14162]: audit 2024-02-22T18:56:37.666180+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:56:38.519 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:38 smithi040 bash[39752]: debug 2024-02-22T18:56:38.175+0000 7fed038d8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T18:56:38.519 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:38 smithi040 bash[39752]: debug 2024-02-22T18:56:38.403+0000 7fed038d8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T18:56:38.930 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:56:38 smithi040 bash[39752]: debug 2024-02-22T18:56:38.511+0000 7fed038d8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T18:56:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[13988]: cephadm 2024-02-22T18:56:37.659990+0000 mgr.x (mgr.34751) 144 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:56:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[13988]: cluster 2024-02-22T18:56:38.536620+0000 mon.a (mon.0) 865 : cluster [DBG] Standby manager daemon y restarted 2024-02-22T18:56:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[13988]: cluster 2024-02-22T18:56:38.536932+0000 mon.a (mon.0) 866 : cluster [DBG] Standby manager daemon y started 2024-02-22T18:56:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[13988]: audit 2024-02-22T18:56:38.538666+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-22T18:56:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[13988]: audit 2024-02-22T18:56:38.539937+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:56:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[13988]: audit 2024-02-22T18:56:38.541998+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-22T18:56:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[13988]: audit 2024-02-22T18:56:38.542609+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:56:39.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[17964]: cephadm 2024-02-22T18:56:37.659990+0000 mgr.x (mgr.34751) 144 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:56:39.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[17964]: cluster 2024-02-22T18:56:38.536620+0000 mon.a (mon.0) 865 : cluster [DBG] Standby manager daemon y restarted 2024-02-22T18:56:39.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[17964]: cluster 2024-02-22T18:56:38.536932+0000 mon.a (mon.0) 866 : cluster [DBG] Standby manager daemon y started 2024-02-22T18:56:39.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[17964]: audit 2024-02-22T18:56:38.538666+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-22T18:56:39.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[17964]: audit 2024-02-22T18:56:38.539937+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:56:39.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[17964]: audit 2024-02-22T18:56:38.541998+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-22T18:56:39.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:39 smithi040 bash[17964]: audit 2024-02-22T18:56:38.542609+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:56:39.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:39 smithi111 bash[14162]: cephadm 2024-02-22T18:56:37.659990+0000 mgr.x (mgr.34751) 144 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:56:39.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:39 smithi111 bash[14162]: cluster 2024-02-22T18:56:38.536620+0000 mon.a (mon.0) 865 : cluster [DBG] Standby manager daemon y restarted 2024-02-22T18:56:39.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:39 smithi111 bash[14162]: cluster 2024-02-22T18:56:38.536932+0000 mon.a (mon.0) 866 : cluster [DBG] Standby manager daemon y started 2024-02-22T18:56:39.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:39 smithi111 bash[14162]: audit 2024-02-22T18:56:38.538666+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-22T18:56:39.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:39 smithi111 bash[14162]: audit 2024-02-22T18:56:38.539937+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:56:39.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:39 smithi111 bash[14162]: audit 2024-02-22T18:56:38.541998+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-22T18:56:39.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:39 smithi111 bash[14162]: audit 2024-02-22T18:56:38.542609+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.? 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:56:40.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:40 smithi040 bash[13988]: cluster 2024-02-22T18:56:39.409496+0000 mon.a (mon.0) 867 : cluster [DBG] mgrmap e21: x(active, since 4m), standbys: y 2024-02-22T18:56:40.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:40 smithi040 bash[13988]: cluster 2024-02-22T18:56:39.436326+0000 mgr.x (mgr.34751) 145 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:40.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:40 smithi040 bash[17964]: cluster 2024-02-22T18:56:39.409496+0000 mon.a (mon.0) 867 : cluster [DBG] mgrmap e21: x(active, since 4m), standbys: y 2024-02-22T18:56:40.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:40 smithi040 bash[17964]: cluster 2024-02-22T18:56:39.436326+0000 mgr.x (mgr.34751) 145 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:40.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:40 smithi111 bash[14162]: cluster 2024-02-22T18:56:39.409496+0000 mon.a (mon.0) 867 : cluster [DBG] mgrmap e21: x(active, since 4m), standbys: y 2024-02-22T18:56:40.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:40 smithi111 bash[14162]: cluster 2024-02-22T18:56:39.436326+0000 mgr.x (mgr.34751) 145 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:41.630Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:41.630Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:41.630Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:56:42.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:42 smithi040 bash[13988]: cluster 2024-02-22T18:56:41.437775+0000 mgr.x (mgr.34751) 146 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:42.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:42 smithi040 bash[17964]: cluster 2024-02-22T18:56:41.437775+0000 mgr.x (mgr.34751) 146 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:42.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:42 smithi111 bash[14162]: cluster 2024-02-22T18:56:41.437775+0000 mgr.x (mgr.34751) 146 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:43.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:43.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:43.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:43.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:43.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:56:44.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:44 smithi040 bash[13988]: cluster 2024-02-22T18:56:43.438431+0000 mgr.x (mgr.34751) 147 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:44 smithi040 bash[17964]: cluster 2024-02-22T18:56:43.438431+0000 mgr.x (mgr.34751) 147 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:44 smithi111 bash[14162]: cluster 2024-02-22T18:56:43.438431+0000 mgr.x (mgr.34751) 147 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:46.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:46 smithi040 bash[13988]: cluster 2024-02-22T18:56:45.439135+0000 mgr.x (mgr.34751) 148 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:46.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:46 smithi040 bash[17964]: cluster 2024-02-22T18:56:45.439135+0000 mgr.x (mgr.34751) 148 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:46.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:46 smithi111 bash[14162]: cluster 2024-02-22T18:56:45.439135+0000 mgr.x (mgr.34751) 148 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:48.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:48 smithi040 bash[13988]: cluster 2024-02-22T18:56:47.440604+0000 mgr.x (mgr.34751) 149 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:48.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:48 smithi040 bash[17964]: cluster 2024-02-22T18:56:47.440604+0000 mgr.x (mgr.34751) 149 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:48.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:48 smithi111 bash[14162]: cluster 2024-02-22T18:56:47.440604+0000 mgr.x (mgr.34751) 149 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:50.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:50 smithi040 bash[13988]: cluster 2024-02-22T18:56:49.441282+0000 mgr.x (mgr.34751) 150 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:50.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:50 smithi040 bash[17964]: cluster 2024-02-22T18:56:49.441282+0000 mgr.x (mgr.34751) 150 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:50.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:50 smithi111 bash[14162]: cluster 2024-02-22T18:56:49.441282+0000 mgr.x (mgr.34751) 150 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:51.630Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:51.630Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:51.630Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:56:52.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:52 smithi040 bash[13988]: cluster 2024-02-22T18:56:51.442715+0000 mgr.x (mgr.34751) 151 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:52.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:52 smithi040 bash[17964]: cluster 2024-02-22T18:56:51.442715+0000 mgr.x (mgr.34751) 151 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:52.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:52 smithi111 bash[14162]: cluster 2024-02-22T18:56:51.442715+0000 mgr.x (mgr.34751) 151 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:53.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:53.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:56:53.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:53.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:56:53.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:56:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:56:53.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:56:54.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:54 smithi040 bash[13988]: cluster 2024-02-22T18:56:53.443412+0000 mgr.x (mgr.34751) 152 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:54.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:54 smithi040 bash[17964]: cluster 2024-02-22T18:56:53.443412+0000 mgr.x (mgr.34751) 152 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:54.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:54 smithi111 bash[14162]: cluster 2024-02-22T18:56:53.443412+0000 mgr.x (mgr.34751) 152 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:56.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:56 smithi040 bash[13988]: cluster 2024-02-22T18:56:55.444104+0000 mgr.x (mgr.34751) 153 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:56.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:56 smithi040 bash[17964]: cluster 2024-02-22T18:56:55.444104+0000 mgr.x (mgr.34751) 153 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:56.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:56 smithi111 bash[14162]: cluster 2024-02-22T18:56:55.444104+0000 mgr.x (mgr.34751) 153 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:56:58.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:56:58 smithi040 bash[13988]: cluster 2024-02-22T18:56:57.445589+0000 mgr.x (mgr.34751) 154 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:58.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:56:58 smithi040 bash[17964]: cluster 2024-02-22T18:56:57.445589+0000 mgr.x (mgr.34751) 154 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:56:58.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:56:58 smithi111 bash[14162]: cluster 2024-02-22T18:56:57.445589+0000 mgr.x (mgr.34751) 154 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:00 smithi040 bash[13988]: cluster 2024-02-22T18:56:59.446248+0000 mgr.x (mgr.34751) 155 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:00.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:00 smithi040 bash[17964]: cluster 2024-02-22T18:56:59.446248+0000 mgr.x (mgr.34751) 155 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:00 smithi111 bash[14162]: cluster 2024-02-22T18:56:59.446248+0000 mgr.x (mgr.34751) 155 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:01.631Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:01.631Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:01.631Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:57:02.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:02 smithi040 bash[13988]: cluster 2024-02-22T18:57:01.447659+0000 mgr.x (mgr.34751) 156 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:02 smithi040 bash[17964]: cluster 2024-02-22T18:57:01.447659+0000 mgr.x (mgr.34751) 156 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:02.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:02 smithi111 bash[14162]: cluster 2024-02-22T18:57:01.447659+0000 mgr.x (mgr.34751) 156 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:03.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:03.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:03.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:03.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:57:04.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:04 smithi040 bash[13988]: cluster 2024-02-22T18:57:03.448360+0000 mgr.x (mgr.34751) 157 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:04.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:04 smithi040 bash[17964]: cluster 2024-02-22T18:57:03.448360+0000 mgr.x (mgr.34751) 157 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:04.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:04 smithi111 bash[14162]: cluster 2024-02-22T18:57:03.448360+0000 mgr.x (mgr.34751) 157 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:06.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:06 smithi040 bash[13988]: cluster 2024-02-22T18:57:05.449058+0000 mgr.x (mgr.34751) 158 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:06 smithi040 bash[17964]: cluster 2024-02-22T18:57:05.449058+0000 mgr.x (mgr.34751) 158 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:06.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:06 smithi111 bash[14162]: cluster 2024-02-22T18:57:05.449058+0000 mgr.x (mgr.34751) 158 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:08.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:08 smithi040 bash[13988]: cluster 2024-02-22T18:57:07.450595+0000 mgr.x (mgr.34751) 159 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:08.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:08 smithi040 bash[17964]: cluster 2024-02-22T18:57:07.450595+0000 mgr.x (mgr.34751) 159 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:08.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:08 smithi111 bash[14162]: cluster 2024-02-22T18:57:07.450595+0000 mgr.x (mgr.34751) 159 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:10.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:10 smithi040 bash[13988]: cluster 2024-02-22T18:57:09.451339+0000 mgr.x (mgr.34751) 160 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:10.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:10 smithi040 bash[17964]: cluster 2024-02-22T18:57:09.451339+0000 mgr.x (mgr.34751) 160 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:10.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:10 smithi111 bash[14162]: cluster 2024-02-22T18:57:09.451339+0000 mgr.x (mgr.34751) 160 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:11.631Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:11.631Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:11.631Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:57:12.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:12 smithi040 bash[13988]: cluster 2024-02-22T18:57:11.452811+0000 mgr.x (mgr.34751) 161 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:12.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:12 smithi040 bash[17964]: cluster 2024-02-22T18:57:11.452811+0000 mgr.x (mgr.34751) 161 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:12.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:12 smithi111 bash[14162]: cluster 2024-02-22T18:57:11.452811+0000 mgr.x (mgr.34751) 161 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:13.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:13.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:13.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:13.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:13.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:57:14.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:14 smithi040 bash[13988]: cluster 2024-02-22T18:57:13.453531+0000 mgr.x (mgr.34751) 162 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:14.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:14 smithi040 bash[17964]: cluster 2024-02-22T18:57:13.453531+0000 mgr.x (mgr.34751) 162 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:14.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:14 smithi111 bash[14162]: cluster 2024-02-22T18:57:13.453531+0000 mgr.x (mgr.34751) 162 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:16.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:16 smithi040 bash[13988]: cluster 2024-02-22T18:57:15.454230+0000 mgr.x (mgr.34751) 163 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:16.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:16 smithi040 bash[17964]: cluster 2024-02-22T18:57:15.454230+0000 mgr.x (mgr.34751) 163 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:16 smithi111 bash[14162]: cluster 2024-02-22T18:57:15.454230+0000 mgr.x (mgr.34751) 163 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:18.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:18 smithi040 bash[13988]: cluster 2024-02-22T18:57:17.455709+0000 mgr.x (mgr.34751) 164 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:18.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:18 smithi040 bash[17964]: cluster 2024-02-22T18:57:17.455709+0000 mgr.x (mgr.34751) 164 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:18.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:18 smithi111 bash[14162]: cluster 2024-02-22T18:57:17.455709+0000 mgr.x (mgr.34751) 164 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:20.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:20 smithi040 bash[13988]: cluster 2024-02-22T18:57:19.456467+0000 mgr.x (mgr.34751) 165 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:20.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:20 smithi040 bash[17964]: cluster 2024-02-22T18:57:19.456467+0000 mgr.x (mgr.34751) 165 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:20.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:20 smithi111 bash[14162]: cluster 2024-02-22T18:57:19.456467+0000 mgr.x (mgr.34751) 165 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:21.631Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:21.631Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:21.632Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:57:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:22 smithi040 bash[17964]: cluster 2024-02-22T18:57:21.457906+0000 mgr.x (mgr.34751) 166 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:22.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:22 smithi040 bash[13988]: cluster 2024-02-22T18:57:21.457906+0000 mgr.x (mgr.34751) 166 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:22.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:22 smithi111 bash[14162]: cluster 2024-02-22T18:57:21.457906+0000 mgr.x (mgr.34751) 166 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:23.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:23.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:23.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:23.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:23.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:57:24.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:24 smithi040 bash[13988]: cluster 2024-02-22T18:57:23.458610+0000 mgr.x (mgr.34751) 167 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:24.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:24 smithi040 bash[17964]: cluster 2024-02-22T18:57:23.458610+0000 mgr.x (mgr.34751) 167 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:24.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:24 smithi111 bash[14162]: cluster 2024-02-22T18:57:23.458610+0000 mgr.x (mgr.34751) 167 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:26.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:26 smithi040 bash[13988]: cluster 2024-02-22T18:57:25.459310+0000 mgr.x (mgr.34751) 168 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:26.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:26 smithi040 bash[17964]: cluster 2024-02-22T18:57:25.459310+0000 mgr.x (mgr.34751) 168 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:26.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:26 smithi111 bash[14162]: cluster 2024-02-22T18:57:25.459310+0000 mgr.x (mgr.34751) 168 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:28.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:28 smithi040 bash[13988]: cluster 2024-02-22T18:57:27.460740+0000 mgr.x (mgr.34751) 169 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:28.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:28 smithi040 bash[17964]: cluster 2024-02-22T18:57:27.460740+0000 mgr.x (mgr.34751) 169 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:28.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:28 smithi111 bash[14162]: cluster 2024-02-22T18:57:27.460740+0000 mgr.x (mgr.34751) 169 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:30.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:30 smithi040 bash[13988]: cluster 2024-02-22T18:57:29.461488+0000 mgr.x (mgr.34751) 170 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:30.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:30 smithi040 bash[17964]: cluster 2024-02-22T18:57:29.461488+0000 mgr.x (mgr.34751) 170 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:30.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:30 smithi111 bash[14162]: cluster 2024-02-22T18:57:29.461488+0000 mgr.x (mgr.34751) 170 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:31.632Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:31.632Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:31.632Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:57:32.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:32 smithi040 bash[13988]: cluster 2024-02-22T18:57:31.462979+0000 mgr.x (mgr.34751) 171 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:32.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:32 smithi040 bash[17964]: cluster 2024-02-22T18:57:31.462979+0000 mgr.x (mgr.34751) 171 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:32 smithi111 bash[14162]: cluster 2024-02-22T18:57:31.462979+0000 mgr.x (mgr.34751) 171 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:33.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:33.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:33.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:33.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:33.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:33.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:57:34.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:34 smithi040 bash[13988]: cluster 2024-02-22T18:57:33.463715+0000 mgr.x (mgr.34751) 172 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:34.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:34 smithi040 bash[17964]: cluster 2024-02-22T18:57:33.463715+0000 mgr.x (mgr.34751) 172 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:34.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:34 smithi111 bash[14162]: cluster 2024-02-22T18:57:33.463715+0000 mgr.x (mgr.34751) 172 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:35.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:35 smithi040 bash[13988]: audit 2024-02-22T18:57:35.403954+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-22T18:57:35.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:35 smithi040 bash[13988]: audit 2024-02-22T18:57:35.404614+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-22T18:57:35.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:35 smithi040 bash[13988]: audit 2024-02-22T18:57:35.405153+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T18:57:35.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:35 smithi040 bash[17964]: audit 2024-02-22T18:57:35.403954+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-22T18:57:35.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:35 smithi040 bash[17964]: audit 2024-02-22T18:57:35.404614+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-22T18:57:35.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:35 smithi040 bash[17964]: audit 2024-02-22T18:57:35.405153+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T18:57:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:35 smithi111 bash[14162]: audit 2024-02-22T18:57:35.403954+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-22T18:57:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:35 smithi111 bash[14162]: audit 2024-02-22T18:57:35.404614+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-22T18:57:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:35 smithi111 bash[14162]: audit 2024-02-22T18:57:35.405153+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T18:57:36.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:36 smithi040 bash[13988]: cluster 2024-02-22T18:57:35.464371+0000 mgr.x (mgr.34751) 173 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:36.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:36 smithi040 bash[17964]: cluster 2024-02-22T18:57:35.464371+0000 mgr.x (mgr.34751) 173 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:36.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:36 smithi111 bash[14162]: cluster 2024-02-22T18:57:35.464371+0000 mgr.x (mgr.34751) 173 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:38.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:38 smithi040 bash[13988]: cluster 2024-02-22T18:57:37.465940+0000 mgr.x (mgr.34751) 174 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:38.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:38 smithi040 bash[13988]: audit 2024-02-22T18:57:37.681046+0000 mon.a (mon.0) 871 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:57:38.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:38 smithi040 bash[17964]: cluster 2024-02-22T18:57:37.465940+0000 mgr.x (mgr.34751) 174 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:38.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:38 smithi040 bash[17964]: audit 2024-02-22T18:57:37.681046+0000 mon.a (mon.0) 871 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:57:38.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:38 smithi111 bash[14162]: cluster 2024-02-22T18:57:37.465940+0000 mgr.x (mgr.34751) 174 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:38.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:38 smithi111 bash[14162]: audit 2024-02-22T18:57:37.681046+0000 mon.a (mon.0) 871 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:57:40.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:40 smithi040 bash[13988]: cluster 2024-02-22T18:57:39.466696+0000 mgr.x (mgr.34751) 175 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:40.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:40 smithi040 bash[17964]: cluster 2024-02-22T18:57:39.466696+0000 mgr.x (mgr.34751) 175 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:40.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:40 smithi111 bash[14162]: cluster 2024-02-22T18:57:39.466696+0000 mgr.x (mgr.34751) 175 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:41.632Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:41.632Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:41.632Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:57:42.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:42 smithi040 bash[13988]: cluster 2024-02-22T18:57:41.468127+0000 mgr.x (mgr.34751) 176 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:42.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:42 smithi040 bash[17964]: cluster 2024-02-22T18:57:41.468127+0000 mgr.x (mgr.34751) 176 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:42.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:42 smithi111 bash[14162]: cluster 2024-02-22T18:57:41.468127+0000 mgr.x (mgr.34751) 176 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:43.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:43.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:43.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:57:44.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[13988]: cluster 2024-02-22T18:57:43.468844+0000 mgr.x (mgr.34751) 177 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:44.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[13988]: audit 2024-02-22T18:57:43.965501+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:57:44.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[13988]: audit 2024-02-22T18:57:44.236010+0000 mon.a (mon.0) 873 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:57:44.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[13988]: audit 2024-02-22T18:57:44.238366+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:57:44.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[13988]: audit 2024-02-22T18:57:44.247742+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:57:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[17964]: cluster 2024-02-22T18:57:43.468844+0000 mgr.x (mgr.34751) 177 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[17964]: audit 2024-02-22T18:57:43.965501+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:57:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[17964]: audit 2024-02-22T18:57:44.236010+0000 mon.a (mon.0) 873 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:57:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[17964]: audit 2024-02-22T18:57:44.238366+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:57:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:44 smithi040 bash[17964]: audit 2024-02-22T18:57:44.247742+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:57:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:44 smithi111 bash[14162]: cluster 2024-02-22T18:57:43.468844+0000 mgr.x (mgr.34751) 177 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:44 smithi111 bash[14162]: audit 2024-02-22T18:57:43.965501+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:57:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:44 smithi111 bash[14162]: audit 2024-02-22T18:57:44.236010+0000 mon.a (mon.0) 873 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:57:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:44 smithi111 bash[14162]: audit 2024-02-22T18:57:44.238366+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:57:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:44 smithi111 bash[14162]: audit 2024-02-22T18:57:44.247742+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:57:45.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:45 smithi040 bash[13988]: cephadm 2024-02-22T18:57:44.241194+0000 mgr.x (mgr.34751) 178 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:57:45.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:45 smithi040 bash[17964]: cephadm 2024-02-22T18:57:44.241194+0000 mgr.x (mgr.34751) 178 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:57:45.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:45 smithi111 bash[14162]: cephadm 2024-02-22T18:57:44.241194+0000 mgr.x (mgr.34751) 178 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:57:46.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:46 smithi040 bash[13988]: cluster 2024-02-22T18:57:45.469560+0000 mgr.x (mgr.34751) 179 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:46.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:46 smithi040 bash[17964]: cluster 2024-02-22T18:57:45.469560+0000 mgr.x (mgr.34751) 179 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:46.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:46 smithi111 bash[14162]: cluster 2024-02-22T18:57:45.469560+0000 mgr.x (mgr.34751) 179 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:48.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:48 smithi040 bash[13988]: cluster 2024-02-22T18:57:47.471038+0000 mgr.x (mgr.34751) 180 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:48.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:48 smithi040 bash[17964]: cluster 2024-02-22T18:57:47.471038+0000 mgr.x (mgr.34751) 180 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:48.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:48 smithi111 bash[14162]: cluster 2024-02-22T18:57:47.471038+0000 mgr.x (mgr.34751) 180 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:50.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:50 smithi040 bash[13988]: cluster 2024-02-22T18:57:49.471783+0000 mgr.x (mgr.34751) 181 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:50.987 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:50 smithi040 bash[17964]: cluster 2024-02-22T18:57:49.471783+0000 mgr.x (mgr.34751) 181 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:50.987 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:50 smithi111 bash[14162]: cluster 2024-02-22T18:57:49.471783+0000 mgr.x (mgr.34751) 181 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:51.632Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:51.632Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:51.633Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:57:52.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:52 smithi040 bash[13988]: cluster 2024-02-22T18:57:51.473225+0000 mgr.x (mgr.34751) 182 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:52.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:52 smithi040 bash[17964]: cluster 2024-02-22T18:57:51.473225+0000 mgr.x (mgr.34751) 182 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:52.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:52 smithi111 bash[14162]: cluster 2024-02-22T18:57:51.473225+0000 mgr.x (mgr.34751) 182 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:53.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:53.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:57:53.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:53.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:57:53.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:57:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:57:53.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:57:54.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:54 smithi040 bash[13988]: cluster 2024-02-22T18:57:53.473995+0000 mgr.x (mgr.34751) 183 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:54.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:54 smithi040 bash[17964]: cluster 2024-02-22T18:57:53.473995+0000 mgr.x (mgr.34751) 183 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:54.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:54 smithi111 bash[14162]: cluster 2024-02-22T18:57:53.473995+0000 mgr.x (mgr.34751) 183 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:56 smithi040 bash[17964]: cluster 2024-02-22T18:57:55.474701+0000 mgr.x (mgr.34751) 184 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:56.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:56 smithi040 bash[13988]: cluster 2024-02-22T18:57:55.474701+0000 mgr.x (mgr.34751) 184 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:56.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:56 smithi111 bash[14162]: cluster 2024-02-22T18:57:55.474701+0000 mgr.x (mgr.34751) 184 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:57:58.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:57:58 smithi040 bash[13988]: cluster 2024-02-22T18:57:57.476561+0000 mgr.x (mgr.34751) 185 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:58.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:57:58 smithi040 bash[17964]: cluster 2024-02-22T18:57:57.476561+0000 mgr.x (mgr.34751) 185 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:57:58.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:57:58 smithi111 bash[14162]: cluster 2024-02-22T18:57:57.476561+0000 mgr.x (mgr.34751) 185 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:00 smithi040 bash[13988]: cluster 2024-02-22T18:57:59.477368+0000 mgr.x (mgr.34751) 186 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:00.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:00 smithi040 bash[17964]: cluster 2024-02-22T18:57:59.477368+0000 mgr.x (mgr.34751) 186 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:00 smithi111 bash[14162]: cluster 2024-02-22T18:57:59.477368+0000 mgr.x (mgr.34751) 186 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:01.633Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:01.633Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:01.633Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:58:02.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:02 smithi040 bash[13988]: cluster 2024-02-22T18:58:01.478807+0000 mgr.x (mgr.34751) 187 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:02.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:02 smithi040 bash[17964]: cluster 2024-02-22T18:58:01.478807+0000 mgr.x (mgr.34751) 187 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:02.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:02 smithi111 bash[14162]: cluster 2024-02-22T18:58:01.478807+0000 mgr.x (mgr.34751) 187 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:03.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:03.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:03.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:03.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:58:04.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:04 smithi040 bash[13988]: cluster 2024-02-22T18:58:03.479524+0000 mgr.x (mgr.34751) 188 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:04.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:04 smithi040 bash[17964]: cluster 2024-02-22T18:58:03.479524+0000 mgr.x (mgr.34751) 188 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:04.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:04 smithi111 bash[14162]: cluster 2024-02-22T18:58:03.479524+0000 mgr.x (mgr.34751) 188 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:06.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:06 smithi040 bash[13988]: cluster 2024-02-22T18:58:05.480267+0000 mgr.x (mgr.34751) 189 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:06.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:06 smithi040 bash[17964]: cluster 2024-02-22T18:58:05.480267+0000 mgr.x (mgr.34751) 189 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:06.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:06 smithi111 bash[14162]: cluster 2024-02-22T18:58:05.480267+0000 mgr.x (mgr.34751) 189 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:08.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:08 smithi040 bash[13988]: cluster 2024-02-22T18:58:07.481777+0000 mgr.x (mgr.34751) 190 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:08.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:08 smithi040 bash[17964]: cluster 2024-02-22T18:58:07.481777+0000 mgr.x (mgr.34751) 190 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:08.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:08 smithi111 bash[14162]: cluster 2024-02-22T18:58:07.481777+0000 mgr.x (mgr.34751) 190 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:10.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:10 smithi040 bash[13988]: cluster 2024-02-22T18:58:09.482451+0000 mgr.x (mgr.34751) 191 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:10.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:10 smithi040 bash[17964]: cluster 2024-02-22T18:58:09.482451+0000 mgr.x (mgr.34751) 191 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:10.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:10 smithi111 bash[14162]: cluster 2024-02-22T18:58:09.482451+0000 mgr.x (mgr.34751) 191 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:11.633Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:11.633Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:11.633Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:58:12.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:12 smithi040 bash[13988]: cluster 2024-02-22T18:58:11.483864+0000 mgr.x (mgr.34751) 192 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:12.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:12 smithi040 bash[17964]: cluster 2024-02-22T18:58:11.483864+0000 mgr.x (mgr.34751) 192 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:12.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:12 smithi111 bash[14162]: cluster 2024-02-22T18:58:11.483864+0000 mgr.x (mgr.34751) 192 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:13.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:13.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:13.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:58:14.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:14 smithi040 bash[13988]: cluster 2024-02-22T18:58:13.484589+0000 mgr.x (mgr.34751) 193 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:14.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:14 smithi040 bash[17964]: cluster 2024-02-22T18:58:13.484589+0000 mgr.x (mgr.34751) 193 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:14.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:14 smithi111 bash[14162]: cluster 2024-02-22T18:58:13.484589+0000 mgr.x (mgr.34751) 193 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:16.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:16 smithi040 bash[13988]: cluster 2024-02-22T18:58:15.485290+0000 mgr.x (mgr.34751) 194 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:16.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:16 smithi040 bash[17964]: cluster 2024-02-22T18:58:15.485290+0000 mgr.x (mgr.34751) 194 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:16 smithi111 bash[14162]: cluster 2024-02-22T18:58:15.485290+0000 mgr.x (mgr.34751) 194 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:18.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:18 smithi040 bash[13988]: cluster 2024-02-22T18:58:17.486755+0000 mgr.x (mgr.34751) 195 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:18.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:18 smithi040 bash[17964]: cluster 2024-02-22T18:58:17.486755+0000 mgr.x (mgr.34751) 195 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:18.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:18 smithi111 bash[14162]: cluster 2024-02-22T18:58:17.486755+0000 mgr.x (mgr.34751) 195 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:20.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:20 smithi040 bash[13988]: cluster 2024-02-22T18:58:19.487492+0000 mgr.x (mgr.34751) 196 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:20.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:20 smithi040 bash[17964]: cluster 2024-02-22T18:58:19.487492+0000 mgr.x (mgr.34751) 196 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:20.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:20 smithi111 bash[14162]: cluster 2024-02-22T18:58:19.487492+0000 mgr.x (mgr.34751) 196 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:21.634Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:21.634Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:21.634Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:58:22.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:22 smithi040 bash[13988]: cluster 2024-02-22T18:58:21.488958+0000 mgr.x (mgr.34751) 197 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:22 smithi040 bash[17964]: cluster 2024-02-22T18:58:21.488958+0000 mgr.x (mgr.34751) 197 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:22.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:22 smithi111 bash[14162]: cluster 2024-02-22T18:58:21.488958+0000 mgr.x (mgr.34751) 197 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:23.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:23.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:23.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:23.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:23.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:23.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:58:24.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:24 smithi040 bash[13988]: cluster 2024-02-22T18:58:23.489791+0000 mgr.x (mgr.34751) 198 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:24.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:24 smithi040 bash[17964]: cluster 2024-02-22T18:58:23.489791+0000 mgr.x (mgr.34751) 198 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:24 smithi111 bash[14162]: cluster 2024-02-22T18:58:23.489791+0000 mgr.x (mgr.34751) 198 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:26.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:26 smithi040 bash[13988]: cluster 2024-02-22T18:58:25.490612+0000 mgr.x (mgr.34751) 199 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:26.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:26 smithi040 bash[17964]: cluster 2024-02-22T18:58:25.490612+0000 mgr.x (mgr.34751) 199 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:26.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:26 smithi111 bash[14162]: cluster 2024-02-22T18:58:25.490612+0000 mgr.x (mgr.34751) 199 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:28.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:28 smithi040 bash[13988]: cluster 2024-02-22T18:58:27.492144+0000 mgr.x (mgr.34751) 200 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:28.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:28 smithi040 bash[17964]: cluster 2024-02-22T18:58:27.492144+0000 mgr.x (mgr.34751) 200 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:28.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:28 smithi111 bash[14162]: cluster 2024-02-22T18:58:27.492144+0000 mgr.x (mgr.34751) 200 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:30.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:30 smithi040 bash[13988]: cluster 2024-02-22T18:58:29.493051+0000 mgr.x (mgr.34751) 201 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:30.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:30 smithi040 bash[17964]: cluster 2024-02-22T18:58:29.493051+0000 mgr.x (mgr.34751) 201 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:30.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:30 smithi111 bash[14162]: cluster 2024-02-22T18:58:29.493051+0000 mgr.x (mgr.34751) 201 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:31.634Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:31.634Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:31.634Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:58:32.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:32 smithi040 bash[13988]: cluster 2024-02-22T18:58:31.494569+0000 mgr.x (mgr.34751) 202 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:32.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:32 smithi040 bash[17964]: cluster 2024-02-22T18:58:31.494569+0000 mgr.x (mgr.34751) 202 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:32 smithi111 bash[14162]: cluster 2024-02-22T18:58:31.494569+0000 mgr.x (mgr.34751) 202 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:33.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:33.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:33.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:33.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:33.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:33.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:58:34.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:34 smithi040 bash[13988]: cluster 2024-02-22T18:58:33.495298+0000 mgr.x (mgr.34751) 203 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:34.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:34 smithi040 bash[17964]: cluster 2024-02-22T18:58:33.495298+0000 mgr.x (mgr.34751) 203 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:34.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:34 smithi111 bash[14162]: cluster 2024-02-22T18:58:33.495298+0000 mgr.x (mgr.34751) 203 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:35.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:35 smithi040 bash[13988]: audit 2024-02-22T18:58:35.412285+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-22T18:58:35.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:35 smithi040 bash[13988]: audit 2024-02-22T18:58:35.412955+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-22T18:58:35.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:35 smithi040 bash[13988]: audit 2024-02-22T18:58:35.413570+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T18:58:35.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:35 smithi040 bash[17964]: audit 2024-02-22T18:58:35.412285+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-22T18:58:35.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:35 smithi040 bash[17964]: audit 2024-02-22T18:58:35.412955+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-22T18:58:35.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:35 smithi040 bash[17964]: audit 2024-02-22T18:58:35.413570+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T18:58:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:35 smithi111 bash[14162]: audit 2024-02-22T18:58:35.412285+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-22T18:58:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:35 smithi111 bash[14162]: audit 2024-02-22T18:58:35.412955+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-22T18:58:35.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:35 smithi111 bash[14162]: audit 2024-02-22T18:58:35.413570+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T18:58:36.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:36 smithi040 bash[13988]: cluster 2024-02-22T18:58:35.495976+0000 mgr.x (mgr.34751) 204 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:36.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:36 smithi040 bash[17964]: cluster 2024-02-22T18:58:35.495976+0000 mgr.x (mgr.34751) 204 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:36.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:36 smithi111 bash[14162]: cluster 2024-02-22T18:58:35.495976+0000 mgr.x (mgr.34751) 204 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:38.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:38 smithi040 bash[13988]: cluster 2024-02-22T18:58:37.497605+0000 mgr.x (mgr.34751) 205 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:38.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:38 smithi040 bash[17964]: cluster 2024-02-22T18:58:37.497605+0000 mgr.x (mgr.34751) 205 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:38.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:38 smithi111 bash[14162]: cluster 2024-02-22T18:58:37.497605+0000 mgr.x (mgr.34751) 205 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:40.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:40 smithi040 bash[13988]: cluster 2024-02-22T18:58:39.498422+0000 mgr.x (mgr.34751) 206 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:40.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:40 smithi040 bash[17964]: cluster 2024-02-22T18:58:39.498422+0000 mgr.x (mgr.34751) 206 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:40.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:40 smithi111 bash[14162]: cluster 2024-02-22T18:58:39.498422+0000 mgr.x (mgr.34751) 206 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:41.634Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:41.634Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:41.634Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:58:42.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:42 smithi040 bash[13988]: cluster 2024-02-22T18:58:41.499912+0000 mgr.x (mgr.34751) 207 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:42.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:42 smithi040 bash[17964]: cluster 2024-02-22T18:58:41.499912+0000 mgr.x (mgr.34751) 207 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:42.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:42 smithi111 bash[14162]: cluster 2024-02-22T18:58:41.499912+0000 mgr.x (mgr.34751) 207 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:43.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:43.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:43.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:58:44.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:44 smithi040 bash[13988]: cluster 2024-02-22T18:58:43.500579+0000 mgr.x (mgr.34751) 208 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:44.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:44 smithi040 bash[13988]: audit 2024-02-22T18:58:44.535170+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:58:44.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:44 smithi040 bash[13988]: audit 2024-02-22T18:58:44.545351+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:58:44.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:44 smithi040 bash[17964]: cluster 2024-02-22T18:58:43.500579+0000 mgr.x (mgr.34751) 208 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:44.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:44 smithi040 bash[17964]: audit 2024-02-22T18:58:44.535170+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:58:44.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:44 smithi040 bash[17964]: audit 2024-02-22T18:58:44.545351+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:58:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:44 smithi111 bash[14162]: cluster 2024-02-22T18:58:43.500579+0000 mgr.x (mgr.34751) 208 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:44 smithi111 bash[14162]: audit 2024-02-22T18:58:44.535170+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:58:44.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:44 smithi111 bash[14162]: audit 2024-02-22T18:58:44.545351+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:58:45.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:45 smithi040 bash[13988]: audit 2024-02-22T18:58:44.839809+0000 mon.a (mon.0) 881 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:58:45.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:45 smithi040 bash[13988]: audit 2024-02-22T18:58:44.842013+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:58:45.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:45 smithi040 bash[13988]: audit 2024-02-22T18:58:44.850789+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:58:45.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:45 smithi040 bash[17964]: audit 2024-02-22T18:58:44.839809+0000 mon.a (mon.0) 881 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:58:45.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:45 smithi040 bash[17964]: audit 2024-02-22T18:58:44.842013+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:58:45.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:45 smithi040 bash[17964]: audit 2024-02-22T18:58:44.850789+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:58:45.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:45 smithi111 bash[14162]: audit 2024-02-22T18:58:44.839809+0000 mon.a (mon.0) 881 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:58:45.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:45 smithi111 bash[14162]: audit 2024-02-22T18:58:44.842013+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:58:45.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:45 smithi111 bash[14162]: audit 2024-02-22T18:58:44.850789+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' 2024-02-22T18:58:46.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:46 smithi040 bash[17964]: cephadm 2024-02-22T18:58:44.844704+0000 mgr.x (mgr.34751) 209 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:58:46.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:46 smithi040 bash[17964]: cluster 2024-02-22T18:58:45.501383+0000 mgr.x (mgr.34751) 210 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:46.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:46 smithi040 bash[13988]: cephadm 2024-02-22T18:58:44.844704+0000 mgr.x (mgr.34751) 209 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:58:46.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:46 smithi040 bash[13988]: cluster 2024-02-22T18:58:45.501383+0000 mgr.x (mgr.34751) 210 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:46.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:46 smithi111 bash[14162]: cephadm 2024-02-22T18:58:44.844704+0000 mgr.x (mgr.34751) 209 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:58:46.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:46 smithi111 bash[14162]: cluster 2024-02-22T18:58:45.501383+0000 mgr.x (mgr.34751) 210 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:48.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:48 smithi040 bash[13988]: cluster 2024-02-22T18:58:47.502931+0000 mgr.x (mgr.34751) 211 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:48.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:48 smithi040 bash[17964]: cluster 2024-02-22T18:58:47.502931+0000 mgr.x (mgr.34751) 211 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:48.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:48 smithi111 bash[14162]: cluster 2024-02-22T18:58:47.502931+0000 mgr.x (mgr.34751) 211 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:50.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:50 smithi040 bash[13988]: cluster 2024-02-22T18:58:49.503661+0000 mgr.x (mgr.34751) 212 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:50.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:50 smithi040 bash[17964]: cluster 2024-02-22T18:58:49.503661+0000 mgr.x (mgr.34751) 212 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:50.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:50 smithi111 bash[14162]: cluster 2024-02-22T18:58:49.503661+0000 mgr.x (mgr.34751) 212 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:51.635Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:51.635Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:51.635Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:58:52.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ps' 2024-02-22T18:58:52.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:52 smithi040 bash[13988]: cluster 2024-02-22T18:58:51.505112+0000 mgr.x (mgr.34751) 213 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:52.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:52 smithi040 bash[17964]: cluster 2024-02-22T18:58:51.505112+0000 mgr.x (mgr.34751) 213 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:52.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:52 smithi111 bash[14162]: cluster 2024-02-22T18:58:51.505112+0000 mgr.x (mgr.34751) 213 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:53.680 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:53.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:58:53.680 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:53.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:58:53.680 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:58:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:58:53.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:58:54.897 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:54 smithi040 bash[13988]: cluster 2024-02-22T18:58:53.505835+0000 mgr.x (mgr.34751) 214 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:54.898 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:54 smithi040 bash[17964]: cluster 2024-02-22T18:58:53.505835+0000 mgr.x (mgr.34751) 214 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:54.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:54 smithi111 bash[14162]: cluster 2024-02-22T18:58:53.505835+0000 mgr.x (mgr.34751) 214 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:55.331 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T18:58:55.331 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (14m) 71s ago 15m 14.3M - 0.20.0 0881eb8f169f d07d332bcae5 2024-02-22T18:58:55.331 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi111 running (15m) 2m ago 15m 27.2M - 6.6.2 a0dce381714a 5ee787fea36d 2024-02-22T18:58:55.331 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi.iscsi.a smithi111 running (6m) 2m ago 16m 42.6M - 3.4 dfc483079636 224fd81611fa 2024-02-22T18:58:55.331 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi111 running (8m) 2m ago 19m 419M - 16.2.14-550-geb66ed92 7403d1862307 a875afad2b64 2024-02-22T18:58:55.331 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (2m) 71s ago 21m 376M - 16.2.14-550-geb66ed92 7403d1862307 439ee1bc8662 2024-02-22T18:58:55.331 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (21m) 71s ago 21m 66.4M 2048M 15.2.9 dfc483079636 3c89b7663858 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi111 running (19m) 2m ago 19m 49.8M 2048M 15.2.9 dfc483079636 336462e9a5d0 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (20m) 71s ago 20m 48.8M 2048M 15.2.9 dfc483079636 1f9be7bcd2e0 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (15m) 71s ago 15m 11.8M - 0.18.1 e5a616e4b9cf 3facd7c224ee 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi111 running (15m) 2m ago 15m 12.1M - 0.18.1 e5a616e4b9cf e0f6df3dcf29 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (19m) 71s ago 19m 46.3M 4096M 15.2.9 dfc483079636 6caadfc43004 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (18m) 71s ago 18m 47.0M 4096M 15.2.9 dfc483079636 c752ecdf2341 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (18m) 71s ago 18m 42.7M 4096M 15.2.9 dfc483079636 fa43ac3dae85 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (18m) 71s ago 18m 48.0M 4096M 15.2.9 dfc483079636 df5809aeb58e 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi111 running (17m) 2m ago 17m 46.4M 4096M 15.2.9 dfc483079636 88b0bb37dbaf 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi111 running (17m) 2m ago 17m 44.7M 4096M 15.2.9 dfc483079636 0e91fba2eb35 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi111 running (16m) 2m ago 17m 44.0M 4096M 15.2.9 dfc483079636 7bc8f399b295 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi111 running (16m) 2m ago 16m 46.3M 4096M 15.2.9 dfc483079636 59b477b24a62 2024-02-22T18:58:55.332 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi111 running (5m) 2m ago 15m 40.5M - 2.18.1 de242295e225 88a0cc7fd66c 2024-02-22T18:58:55.333 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.pyjfss smithi040 running (13m) 71s ago 13m 51.0M - 15.2.9 dfc483079636 47df35fb3739 2024-02-22T18:58:55.333 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi111.qafphs smithi111 running (13m) 2m ago 13m 50.3M - 15.2.9 dfc483079636 80fcb09b20c7 2024-02-22T18:58:55.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.294829+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T18:58:55.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.295983+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.296917+0000 mon.a (mon.0) 886 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.297808+0000 mon.a (mon.0) 887 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.298914+0000 mon.a (mon.0) 888 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.300000+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.305861+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.306776+0000 mon.a (mon.0) 891 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.307800+0000 mon.a (mon.0) 892 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.308834+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[13988]: audit 2024-02-22T18:58:55.309583+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.294829+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.295983+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.296917+0000 mon.a (mon.0) 886 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.297808+0000 mon.a (mon.0) 887 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.298914+0000 mon.a (mon.0) 888 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.300000+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.305861+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T18:58:55.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.306776+0000 mon.a (mon.0) 891 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.307800+0000 mon.a (mon.0) 892 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.308834+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:55 smithi040 bash[17964]: audit 2024-02-22T18:58:55.309583+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.294829+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T18:58:55.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.295983+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T18:58:55.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.296917+0000 mon.a (mon.0) 886 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.297808+0000 mon.a (mon.0) 887 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.298914+0000 mon.a (mon.0) 888 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.300000+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.968 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.305861+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T18:58:55.968 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.306776+0000 mon.a (mon.0) 891 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.968 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.307800+0000 mon.a (mon.0) 892 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.968 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.308834+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:55.968 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:55 smithi111 bash[14162]: audit 2024-02-22T18:58:55.309583+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:58:56.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions' 2024-02-22T18:58:56.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:56 smithi040 bash[13988]: audit 2024-02-22T18:58:55.289623+0000 mgr.x (mgr.34751) 215 : audit [DBG] from='client.14931 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:58:56.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:56 smithi040 bash[13988]: cluster 2024-02-22T18:58:55.506488+0000 mgr.x (mgr.34751) 216 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:56 smithi040 bash[17964]: audit 2024-02-22T18:58:55.289623+0000 mgr.x (mgr.34751) 215 : audit [DBG] from='client.14931 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:58:56.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:56 smithi040 bash[17964]: cluster 2024-02-22T18:58:55.506488+0000 mgr.x (mgr.34751) 216 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:56.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:56 smithi111 bash[14162]: audit 2024-02-22T18:58:55.289623+0000 mgr.x (mgr.34751) 215 : audit [DBG] from='client.14931 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T18:58:56.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:56 smithi111 bash[14162]: cluster 2024-02-22T18:58:55.506488+0000 mgr.x (mgr.34751) 216 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:58:58.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:58 smithi040 bash[13988]: cluster 2024-02-22T18:58:57.507965+0000 mgr.x (mgr.34751) 217 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:58.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:58 smithi040 bash[17964]: cluster 2024-02-22T18:58:57.507965+0000 mgr.x (mgr.34751) 217 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:58.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:58 smithi111 bash[14162]: cluster 2024-02-22T18:58:57.507965+0000 mgr.x (mgr.34751) 217 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:58:59.438 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-22T18:58:59.438 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-22T18:58:59.438 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 3 2024-02-22T18:58:59.438 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 8 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 2 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 13, 2024-02-22T18:58:59.439 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T18:58:59.440 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T18:58:59.440 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-22T18:58:59.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:58:59 smithi040 bash[13988]: audit 2024-02-22T18:58:59.434320+0000 mon.b (mon.2) 32 : audit [DBG] from='client.? 172.21.15.40:0/218319836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:58:59.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:58:59 smithi040 bash[17964]: audit 2024-02-22T18:58:59.434320+0000 mon.b (mon.2) 32 : audit [DBG] from='client.? 172.21.15.40:0/218319836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:58:59.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:58:59 smithi111 bash[14162]: audit 2024-02-22T18:58:59.434320+0000 mon.b (mon.2) 32 : audit [DBG] from='client.? 172.21.15.40:0/218319836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T18:59:00.144 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph -s' 2024-02-22T18:59:00.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:00 smithi040 bash[13988]: cluster 2024-02-22T18:58:59.508681+0000 mgr.x (mgr.34751) 218 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:59:00.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:00 smithi040 bash[17964]: cluster 2024-02-22T18:58:59.508681+0000 mgr.x (mgr.34751) 218 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:59:00.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:00 smithi111 bash[14162]: cluster 2024-02-22T18:58:59.508681+0000 mgr.x (mgr.34751) 218 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:59:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:01.635Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:01.635Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:01 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:01.635Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:59:02.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:02 smithi040 bash[13988]: cluster 2024-02-22T18:59:01.510247+0000 mgr.x (mgr.34751) 219 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:59:02.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:02 smithi040 bash[17964]: cluster 2024-02-22T18:59:01.510247+0000 mgr.x (mgr.34751) 219 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:59:02.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:02 smithi111 bash[14162]: cluster 2024-02-22T18:59:01.510247+0000 mgr.x (mgr.34751) 219 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-22T18:59:03.433 INFO:teuthology.orchestra.run.smithi040.stdout: cluster: 2024-02-22T18:59:03.433 INFO:teuthology.orchestra.run.smithi040.stdout: id: 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T18:59:03.433 INFO:teuthology.orchestra.run.smithi040.stdout: health: HEALTH_OK 2024-02-22T18:59:03.433 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:59:03.433 INFO:teuthology.orchestra.run.smithi040.stdout: services: 2024-02-22T18:59:03.433 INFO:teuthology.orchestra.run.smithi040.stdout: mon: 3 daemons, quorum a,c,b (age 19m) 2024-02-22T18:59:03.433 INFO:teuthology.orchestra.run.smithi040.stdout: mgr: x(active, since 6m), standbys: y 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: osd: 8 osds: 8 up (since 16m), 8 in (since 16m) 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: rgw: 2 daemons active (r.z.smithi040.pyjfss, r.z.smithi111.qafphs) 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: task status: 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: data: 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: pools: 6 pools, 132 pgs 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: objects: 202 objects, 7.4 KiB 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: usage: 8.0 GiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: pgs: 132 active+clean 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: io: 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-02-22T18:59:03.434 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T18:59:03.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:03 smithi040 bash[13988]: audit 2024-02-22T18:59:03.428834+0000 mon.a (mon.0) 895 : audit [DBG] from='client.? 172.21.15.40:0/231916316' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:59:03.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:03 smithi040 bash[17964]: audit 2024-02-22T18:59:03.428834+0000 mon.a (mon.0) 895 : audit [DBG] from='client.? 172.21.15.40:0/231916316' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:59:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:03.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:03.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:03.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:03 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:03.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:59:03.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:03 smithi111 bash[14162]: audit 2024-02-22T18:59:03.428834+0000 mon.a (mon.0) 895 : audit [DBG] from='client.? 172.21.15.40:0/231916316' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T18:59:04.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph mgr fail' 2024-02-22T18:59:04.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:04 smithi040 bash[17964]: cluster 2024-02-22T18:59:03.510970+0000 mgr.x (mgr.34751) 220 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:59:04.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:04 smithi040 bash[13988]: cluster 2024-02-22T18:59:03.510970+0000 mgr.x (mgr.34751) 220 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:59:04.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:04 smithi111 bash[14162]: cluster 2024-02-22T18:59:03.510970+0000 mgr.x (mgr.34751) 220 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:59:06.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:06 smithi040 bash[13988]: cluster 2024-02-22T18:59:05.511660+0000 mgr.x (mgr.34751) 221 : cluster [DBG] pgmap v198: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:59:06.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:06 smithi040 bash[17964]: cluster 2024-02-22T18:59:05.511660+0000 mgr.x (mgr.34751) 221 : cluster [DBG] pgmap v198: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:59:06.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:06 smithi111 bash[14162]: cluster 2024-02-22T18:59:05.511660+0000 mgr.x (mgr.34751) 221 : cluster [DBG] pgmap v198: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-22T18:59:08.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[13988]: audit 2024-02-22T18:59:07.389724+0000 mon.a (mon.0) 896 : audit [INF] from='client.? 172.21.15.40:0/1163142981' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T18:59:08.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[13988]: cluster 2024-02-22T18:59:07.395142+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-22T18:59:08.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[13988]: audit 2024-02-22T18:59:07.399861+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T18:59:08.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[13988]: audit 2024-02-22T18:59:07.402072+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T18:59:08.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[13988]: cluster 2024-02-22T18:59:07.512339+0000 mgr.x (mgr.34751) 222 : cluster [DBG] pgmap v200: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:59:08.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[17964]: audit 2024-02-22T18:59:07.389724+0000 mon.a (mon.0) 896 : audit [INF] from='client.? 172.21.15.40:0/1163142981' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T18:59:08.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[17964]: cluster 2024-02-22T18:59:07.395142+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-22T18:59:08.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[17964]: audit 2024-02-22T18:59:07.399861+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T18:59:08.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[17964]: audit 2024-02-22T18:59:07.402072+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T18:59:08.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:08 smithi040 bash[17964]: cluster 2024-02-22T18:59:07.512339+0000 mgr.x (mgr.34751) 222 : cluster [DBG] pgmap v200: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:59:08.443 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[27054]: ignoring --setuser ceph since I am not root 2024-02-22T18:59:08.443 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[27054]: ignoring --setgroup ceph since I am not root 2024-02-22T18:59:08.443 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[27054]: debug 2024-02-22T18:59:08.163+0000 7f9a6e522700 1 -- 172.21.15.111:0/386822848 <== mon.1 v2:172.21.15.40:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d88d7804e0 con 0x55d88d874c00 2024-02-22T18:59:08.444 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[27054]: debug 2024-02-22T18:59:08.323+0000 7f9a7e6ff680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T18:59:08.444 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[14162]: audit 2024-02-22T18:59:07.389724+0000 mon.a (mon.0) 896 : audit [INF] from='client.? 172.21.15.40:0/1163142981' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T18:59:08.444 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[14162]: cluster 2024-02-22T18:59:07.395142+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-22T18:59:08.444 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[14162]: audit 2024-02-22T18:59:07.399861+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T18:59:08.444 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[14162]: audit 2024-02-22T18:59:07.402072+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T18:59:08.444 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[14162]: cluster 2024-02-22T18:59:07.512339+0000 mgr.x (mgr.34751) 222 : cluster [DBG] pgmap v200: 132 pgs: 132 active+clean; 7.4 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T18:59:08.716 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[27054]: debug 2024-02-22T18:59:08.435+0000 7f9a7e6ff680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T18:59:08.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'sleep 180' 2024-02-22T18:59:09.121 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:09 smithi040 bash[13988]: audit 2024-02-22T18:59:08.117349+0000 mon.a (mon.0) 900 : audit [INF] from='client.? 172.21.15.40:0/1163142981' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-22T18:59:09.122 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:09 smithi040 bash[17964]: audit 2024-02-22T18:59:08.117349+0000 mon.a (mon.0) 900 : audit [INF] from='client.? 172.21.15.40:0/1163142981' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-22T18:59:09.122 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:09 smithi040 bash[17964]: cluster 2024-02-22T18:59:08.117482+0000 mon.a (mon.0) 901 : cluster [DBG] mgrmap e22: y(active, starting, since 0.726992s) 2024-02-22T18:59:09.122 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:09 smithi040 bash[17964]: audit 2024-02-22T18:59:08.400930+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T18:59:09.122 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:09 smithi040 bash[17964]: cluster 2024-02-22T18:59:08.401110+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-22T18:59:09.216 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:08 smithi111 bash[27054]: debug 2024-02-22T18:59:08.887+0000 7f9a7e6ff680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T18:59:09.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:09 smithi111 bash[14162]: audit 2024-02-22T18:59:08.117349+0000 mon.a (mon.0) 900 : audit [INF] from='client.? 172.21.15.40:0/1163142981' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-22T18:59:09.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:09 smithi111 bash[14162]: cluster 2024-02-22T18:59:08.117482+0000 mon.a (mon.0) 901 : cluster [DBG] mgrmap e22: y(active, starting, since 0.726992s) 2024-02-22T18:59:09.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:09 smithi111 bash[14162]: audit 2024-02-22T18:59:08.400930+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T18:59:09.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:09 smithi111 bash[14162]: cluster 2024-02-22T18:59:08.401110+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-22T18:59:09.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:09 smithi040 bash[13988]: cluster 2024-02-22T18:59:08.117482+0000 mon.a (mon.0) 901 : cluster [DBG] mgrmap e22: y(active, starting, since 0.726992s) 2024-02-22T18:59:09.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:09 smithi040 bash[13988]: audit 2024-02-22T18:59:08.400930+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34751 172.21.15.111:0/2246094806' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T18:59:09.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:09 smithi040 bash[13988]: cluster 2024-02-22T18:59:08.401110+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-22T18:59:10.131 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:09 smithi111 bash[27054]: debug 2024-02-22T18:59:09.783+0000 7f9a7e6ff680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T18:59:10.132 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:09 smithi111 bash[27054]: debug 2024-02-22T18:59:09.875+0000 7f9a7e6ff680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T18:59:10.466 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:10 smithi111 bash[27054]: debug 2024-02-22T18:59:10.123+0000 7f9a7e6ff680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T18:59:11.494 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:11 smithi111 bash[27054]: debug 2024-02-22T18:59:11.231+0000 7f9a7e6ff680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T18:59:11.494 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:11 smithi111 bash[27054]: debug 2024-02-22T18:59:11.391+0000 7f9a7e6ff680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T18:59:11.821 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:11 smithi111 bash[27054]: debug 2024-02-22T18:59:11.487+0000 7f9a7e6ff680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T18:59:11.821 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:11 smithi111 bash[27054]: debug 2024-02-22T18:59:11.595+0000 7f9a7e6ff680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T18:59:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:11.635Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T18:59:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:11.635Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:11 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:11.636Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:59:12.182 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:11 smithi111 bash[27054]: debug 2024-02-22T18:59:11.815+0000 7f9a7e6ff680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T18:59:12.466 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:12 smithi111 bash[27054]: debug 2024-02-22T18:59:12.175+0000 7f9a7e6ff680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T18:59:12.466 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:12 smithi111 bash[27054]: debug 2024-02-22T18:59:12.291+0000 7f9a7e6ff680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T18:59:13.466 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:13 smithi111 bash[27054]: debug 2024-02-22T18:59:13.139+0000 7f9a7e6ff680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T18:59:13.466 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:13 smithi111 bash[27054]: debug 2024-02-22T18:59:13.239+0000 7f9a7e6ff680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T18:59:13.466 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:13 smithi111 bash[27054]: debug 2024-02-22T18:59:13.355+0000 7f9a7e6ff680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T18:59:13.867 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:13 smithi111 bash[27054]: debug 2024-02-22T18:59:13.575+0000 7f9a7e6ff680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T18:59:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:13.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T18:59:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:13.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: context deadline exceeded" context_err="context deadline exceeded" 2024-02-22T18:59:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:13 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:13.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: context deadline exceeded" 2024-02-22T18:59:14.180 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:13 smithi111 bash[27054]: debug 2024-02-22T18:59:13.859+0000 7f9a7e6ff680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T18:59:14.180 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[27054]: debug 2024-02-22T18:59:14.019+0000 7f9a7e6ff680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T18:59:14.445 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[27054]: debug 2024-02-22T18:59:14.191+0000 7f9a7e6ff680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T18:59:14.446 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[27054]: debug 2024-02-22T18:59:14.407+0000 7f9a7e6ff680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T18:59:14.446 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.121574+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T18:59:14.447 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.121989+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:59:14.447 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.122580+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:59:14.447 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.124562+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T18:59:14.447 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.126390+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T18:59:14.447 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.126895+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T18:59:14.447 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.128310+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T18:59:14.447 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.128801+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:59:14.447 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.129387+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:59:14.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.130050+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:59:14.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.130674+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:59:14.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.131194+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:59:14.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.131720+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:59:14.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.132371+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:59:14.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.132924+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:59:14.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.133374+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T18:59:14.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.134939+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/client_keyrings"}]: dispatch 2024-02-22T18:59:14.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.135562+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.136115+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.136697+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.137280+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.137973+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.138600+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.139210+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.139815+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.140443+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.141021+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T18:59:14.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.141717+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T18:59:14.450 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.142345+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T18:59:14.450 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.142906+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T18:59:14.450 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.143471+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T18:59:14.450 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.144020+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T18:59:14.450 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.144646+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T18:59:14.450 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.145257+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T18:59:14.450 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.145841+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T18:59:14.450 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.146442+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T18:59:14.450 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.147022+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:59:14.451 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.147664+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:59:14.451 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.148294+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T18:59:14.451 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.148927+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T18:59:14.451 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.149581+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T18:59:14.451 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: audit 2024-02-22T18:59:14.150221+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T18:59:14.451 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[14162]: cluster 2024-02-22T18:59:14.170170+0000 mon.a (mon.0) 904 : cluster [INF] Manager daemon y is now available 2024-02-22T18:59:14.452 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.121574+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T18:59:14.452 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.121989+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:59:14.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.122580+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:59:14.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.124562+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T18:59:14.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.126390+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T18:59:14.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.126895+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T18:59:14.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.128310+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T18:59:14.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.128801+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:59:14.453 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.129387+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.130050+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.130674+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.131194+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.131720+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.132371+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.132924+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.133374+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.134939+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/client_keyrings"}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.135562+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.136115+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.136697+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.137280+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T18:59:14.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.137973+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.138600+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.139210+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.139815+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.140443+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.141021+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.141717+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.142345+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.142906+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.143471+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T18:59:14.455 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.144020+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.144646+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.145257+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.145841+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.146442+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.147022+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.147664+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.148294+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.148927+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.149581+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: audit 2024-02-22T18:59:14.150221+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T18:59:14.456 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[13988]: cluster 2024-02-22T18:59:14.170170+0000 mon.a (mon.0) 904 : cluster [INF] Manager daemon y is now available 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.121574+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.121989+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.122580+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.124562+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.126390+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.126895+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.128310+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.128801+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.129387+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T18:59:14.457 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.130050+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.130674+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.131194+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.131720+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.132371+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.132924+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.133374+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.134939+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/client_keyrings"}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.135562+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.136115+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.136697+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.137280+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.137973+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.138600+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.139210+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T18:59:14.458 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.139815+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.140443+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.141021+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.141717+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.142345+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.142906+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.143471+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.144020+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.144646+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.145257+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.145841+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.146442+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.147022+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.147664+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.148294+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.148927+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T18:59:14.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.149581+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T18:59:14.460 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: audit 2024-02-22T18:59:14.150221+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T18:59:14.460 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[17964]: cluster 2024-02-22T18:59:14.170170+0000 mon.a (mon.0) 904 : cluster [INF] Manager daemon y is now available 2024-02-22T18:59:14.716 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 18:59:14 smithi111 bash[27054]: debug 2024-02-22T18:59:14.515+0000 7f9a7e6ff680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T18:59:14.930 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[39752]: Warning: Permanently added '172.21.15.111' (ECDSA) to the list of known hosts. 2024-02-22T18:59:14.930 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 18:59:14 smithi040 bash[39752]: Warning: Permanently added '172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-22T18:59:15.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: cephadm 2024-02-22T18:59:14.192915+0000 mgr.y (mgr.24850) 1 : cephadm [INF] inventory: adjusted host smithi111 addr 'smithi111' -> '172.21.15.111' 2024-02-22T18:59:15.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.196711+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:15.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: cluster 2024-02-22T18:59:14.232884+0000 mon.a (mon.0) 906 : cluster [DBG] mgrmap e23: y(active, since 6s) 2024-02-22T18:59:15.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: cluster 2024-02-22T18:59:14.239178+0000 mgr.y (mgr.24850) 2 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.338101+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.391056+0000 mon.c (mon.1) 77 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.391575+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.443725+0000 mon.c (mon.1) 78 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.444176+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: cluster 2024-02-22T18:59:14.543781+0000 mon.a (mon.0) 909 : cluster [DBG] Standby manager daemon x started 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.544782+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.547556+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.549279+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.550072+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.692398+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:59:15.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:15 smithi111 bash[14162]: audit 2024-02-22T18:59:14.694566+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:59:15.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: cephadm 2024-02-22T18:59:14.192915+0000 mgr.y (mgr.24850) 1 : cephadm [INF] inventory: adjusted host smithi111 addr 'smithi111' -> '172.21.15.111' 2024-02-22T18:59:15.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.196711+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: cluster 2024-02-22T18:59:14.232884+0000 mon.a (mon.0) 906 : cluster [DBG] mgrmap e23: y(active, since 6s) 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: cluster 2024-02-22T18:59:14.239178+0000 mgr.y (mgr.24850) 2 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.338101+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.391056+0000 mon.c (mon.1) 77 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.391575+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.443725+0000 mon.c (mon.1) 78 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.444176+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: cluster 2024-02-22T18:59:14.543781+0000 mon.a (mon.0) 909 : cluster [DBG] Standby manager daemon x started 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.544782+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.547556+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.549279+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.550072+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.692398+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:59:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[13988]: audit 2024-02-22T18:59:14.694566+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: cephadm 2024-02-22T18:59:14.192915+0000 mgr.y (mgr.24850) 1 : cephadm [INF] inventory: adjusted host smithi111 addr 'smithi111' -> '172.21.15.111' 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.196711+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: cluster 2024-02-22T18:59:14.232884+0000 mon.a (mon.0) 906 : cluster [DBG] mgrmap e23: y(active, since 6s) 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: cluster 2024-02-22T18:59:14.239178+0000 mgr.y (mgr.24850) 2 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.338101+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.391056+0000 mon.c (mon.1) 77 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.391575+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.443725+0000 mon.c (mon.1) 78 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.444176+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: cluster 2024-02-22T18:59:14.543781+0000 mon.a (mon.0) 909 : cluster [DBG] Standby manager daemon x started 2024-02-22T18:59:15.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.544782+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T18:59:15.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.547556+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T18:59:15.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.549279+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T18:59:15.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.550072+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.? 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T18:59:15.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.692398+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:59:15.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:15 smithi040 bash[17964]: audit 2024-02-22T18:59:14.694566+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:59:16.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:16 smithi040 bash[17964]: cluster 2024-02-22T18:59:15.239815+0000 mon.a (mon.0) 910 : cluster [DBG] mgrmap e24: y(active, since 7s), standbys: x 2024-02-22T18:59:16.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:16 smithi040 bash[17964]: audit 2024-02-22T18:59:15.242569+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T18:59:16.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:16 smithi040 bash[13988]: cluster 2024-02-22T18:59:15.239815+0000 mon.a (mon.0) 910 : cluster [DBG] mgrmap e24: y(active, since 7s), standbys: x 2024-02-22T18:59:16.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:16 smithi040 bash[13988]: audit 2024-02-22T18:59:15.242569+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T18:59:16.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:16 smithi111 bash[14162]: cluster 2024-02-22T18:59:15.239815+0000 mon.a (mon.0) 910 : cluster [DBG] mgrmap e24: y(active, since 7s), standbys: x 2024-02-22T18:59:16.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:16 smithi111 bash[14162]: audit 2024-02-22T18:59:15.242569+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T18:59:17.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:17 smithi040 bash[17964]: cluster 2024-02-22T18:59:16.126755+0000 mgr.y (mgr.24850) 3 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:17.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:17 smithi040 bash[17964]: cluster 2024-02-22T18:59:16.250044+0000 mon.a (mon.0) 911 : cluster [DBG] mgrmap e25: y(active, since 8s), standbys: x 2024-02-22T18:59:17.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:17 smithi040 bash[13988]: cluster 2024-02-22T18:59:16.126755+0000 mgr.y (mgr.24850) 3 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:17.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:17 smithi040 bash[13988]: cluster 2024-02-22T18:59:16.250044+0000 mon.a (mon.0) 911 : cluster [DBG] mgrmap e25: y(active, since 8s), standbys: x 2024-02-22T18:59:17.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:17 smithi111 bash[14162]: cluster 2024-02-22T18:59:16.126755+0000 mgr.y (mgr.24850) 3 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:17.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:17 smithi111 bash[14162]: cluster 2024-02-22T18:59:16.250044+0000 mon.a (mon.0) 911 : cluster [DBG] mgrmap e25: y(active, since 8s), standbys: x 2024-02-22T18:59:19.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:19 smithi040 bash[13988]: cluster 2024-02-22T18:59:18.127540+0000 mgr.y (mgr.24850) 4 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:19.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:19 smithi040 bash[17964]: cluster 2024-02-22T18:59:18.127540+0000 mgr.y (mgr.24850) 4 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:19.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:19 smithi111 bash[14162]: cluster 2024-02-22T18:59:18.127540+0000 mgr.y (mgr.24850) 4 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:21.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:21 smithi040 bash[17964]: cluster 2024-02-22T18:59:20.128718+0000 mgr.y (mgr.24850) 5 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 869 B/s rd, 0 op/s 2024-02-22T18:59:21.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:21 smithi040 bash[17964]: audit 2024-02-22T18:59:20.993015+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:21.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:21 smithi040 bash[17964]: audit 2024-02-22T18:59:21.263224+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:21.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:21 smithi040 bash[13988]: cluster 2024-02-22T18:59:20.128718+0000 mgr.y (mgr.24850) 5 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 869 B/s rd, 0 op/s 2024-02-22T18:59:21.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:21 smithi040 bash[13988]: audit 2024-02-22T18:59:20.993015+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:21.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:21 smithi040 bash[13988]: audit 2024-02-22T18:59:21.263224+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:21.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:21 smithi111 bash[14162]: cluster 2024-02-22T18:59:20.128718+0000 mgr.y (mgr.24850) 5 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 869 B/s rd, 0 op/s 2024-02-22T18:59:21.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:21 smithi111 bash[14162]: audit 2024-02-22T18:59:20.993015+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:21.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:21 smithi111 bash[14162]: audit 2024-02-22T18:59:21.263224+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:21.636Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:21.636Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:21 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:21.636Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:59:22.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.264309+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.265507+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.272724+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.273359+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.273938+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.274482+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.275037+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.275606+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.366230+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.639196+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.640444+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.641509+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.642578+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.643689+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.644824+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.645782+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.264309+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.265507+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.272724+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.273359+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.273938+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.274482+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.275037+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.275606+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.366230+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.639196+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.640444+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.641509+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.642578+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.643689+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.644824+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.645782+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.646686+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.647568+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.648614+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.649840+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: cephadm 2024-02-22T18:59:21.650934+0000 mgr.y (mgr.24850) 6 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.657292+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: cephadm 2024-02-22T18:59:21.669221+0000 mgr.y (mgr.24850) 7 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.669843+0000 mon.c (mon.1) 102 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.670487+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.681141+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: cephadm 2024-02-22T18:59:21.682220+0000 mgr.y (mgr.24850) 8 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[13988]: audit 2024-02-22T18:59:21.682802+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.646686+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.647568+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.648614+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:59:22.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.649840+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:59:22.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: cephadm 2024-02-22T18:59:21.650934+0000 mgr.y (mgr.24850) 6 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:59:22.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.657292+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:22.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: cephadm 2024-02-22T18:59:21.669221+0000 mgr.y (mgr.24850) 7 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T18:59:22.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.669843+0000 mon.c (mon.1) 102 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:59:22.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.670487+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:59:22.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.681141+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:59:22.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: cephadm 2024-02-22T18:59:21.682220+0000 mgr.y (mgr.24850) 8 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T18:59:22.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:22 smithi040 bash[17964]: audit 2024-02-22T18:59:21.682802+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.264309+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.265507+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.272724+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.273359+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.273938+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.274482+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.275037+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.275606+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.366230+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:22.717 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.639196+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.640444+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.641509+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.642578+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.643689+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.644824+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.645782+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.646686+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.647568+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.648614+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:59:22.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.649840+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:59:22.719 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: cephadm 2024-02-22T18:59:21.650934+0000 mgr.y (mgr.24850) 6 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:59:22.719 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.657292+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:22.719 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: cephadm 2024-02-22T18:59:21.669221+0000 mgr.y (mgr.24850) 7 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T18:59:22.719 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.669843+0000 mon.c (mon.1) 102 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:59:22.719 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.670487+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T18:59:22.719 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.681141+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:59:22.719 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: cephadm 2024-02-22T18:59:21.682220+0000 mgr.y (mgr.24850) 8 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T18:59:22.719 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:22 smithi111 bash[14162]: audit 2024-02-22T18:59:21.682802+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T18:59:23.399 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[14162]: cluster 2024-02-22T18:59:22.129454+0000 mgr.y (mgr.24850) 9 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 648 B/s rd, 0 op/s 2024-02-22T18:59:23.527 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:23 smithi040 bash[13988]: cluster 2024-02-22T18:59:22.129454+0000 mgr.y (mgr.24850) 9 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 648 B/s rd, 0 op/s 2024-02-22T18:59:23.527 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:23 smithi040 bash[17964]: cluster 2024-02-22T18:59:22.129454+0000 mgr.y (mgr.24850) 9 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 648 B/s rd, 0 op/s 2024-02-22T18:59:23.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:23.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:23.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:23.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:23.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:23 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:23.523Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:59:24.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 systemd[1]: Stopping Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self._connect_unixsocket(self.address) 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Call stack: 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:59:24.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self._bootstrap_inner() 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.run() 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/threading.py", line 864, in run 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self._target(*self._args, **self._kwargs) 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/socketserver.py", line 654, in process_request_thread 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.finish_request(request, client_address) 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/socketserver.py", line 364, in finish_request 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.RequestHandlerClass(request, client_address, self) 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/socketserver.py", line 724, in __init__ 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.handle() 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 232, in handle 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: rv = BaseHTTPRequestHandler.handle(self) 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/http/server.py", line 418, in handle 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.handle_one_request() 2024-02-22T18:59:24.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 267, in handle_one_request 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: return self.run_wsgi() 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 209, in run_wsgi 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: execute(self.server.app) 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 200, in execute 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: write(data) 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 165, in write 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.send_response(int(code), msg) 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 271, in send_response 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.log_request(code) 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 312, in log_request 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.log('info', '"%s" %s %s', msg, code, size) 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 323, in log 2024-02-22T18:59:24.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: message % args)) 2024-02-22T18:59:24.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/_internal.py", line 87, in _log 2024-02-22T18:59:24.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: getattr(_logger, type)(message.rstrip(), *args, **kwargs) 2024-02-22T18:59:24.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Message: '::ffff:172.21.15.111 - - [22/Feb/2024 18:52:58] "GET /api/sysinfo/hostname HTTP/1.1" 200 -' 2024-02-22T18:59:24.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Arguments: () 2024-02-22T18:59:24.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: --- Logging error --- 2024-02-22T18:59:24.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:59:24.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:24.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.socket.send(msg) 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self._connect_unixsocket(self.address) 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Call stack: 2024-02-22T18:59:24.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: main() 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2894, in main 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: ssl_context=context) 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/flask/app.py", line 841, in run 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: run_simple(host, port, self, **options) 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 739, in run_simple 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: inner() 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 702, in inner 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: srv.serve_forever() 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 539, in serve_forever 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: HTTPServer.serve_forever(self) 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/socketserver.py", line 236, in serve_forever 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: ready = selector.select(poll_interval) 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/selectors.py", line 376, in select 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: fd_event_list = self._poll.poll(timeout) 2024-02-22T18:59:24.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2898, in signal_stop 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: logger.info("Shutdown received") 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Message: 'Shutdown received' 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Arguments: () 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: --- Logging error --- 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.socket.send(msg) 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:24.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Traceback (most recent call last): 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self._connect_unixsocket(self.address) 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: self.socket.connect(address) 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Call stack: 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: main() 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2894, in main 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: ssl_context=context) 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/flask/app.py", line 841, in run 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: run_simple(host, port, self, **options) 2024-02-22T18:59:24.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 739, in run_simple 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: inner() 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 702, in inner 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: srv.serve_forever() 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/werkzeug/serving.py", line 539, in serve_forever 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: HTTPServer.serve_forever(self) 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/socketserver.py", line 236, in serve_forever 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: ready = selector.select(poll_interval) 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib64/python3.6/selectors.py", line 376, in select 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: fd_event_list = self._poll.poll(timeout) 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/bin/rbd-target-api", line 2901, in signal_stop 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: sys.exit(ceph_gw.delete()) 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 311, in delete 2024-02-22T18:59:24.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: "host ({})".format(self.hostname)) 2024-02-22T18:59:24.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Message: 'No gateway configuration to remove on this host (smithi111.front.sepia.ceph.com)' 2024-02-22T18:59:24.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:23 smithi111 bash[28502]: Arguments: () 2024-02-22T18:59:24.771 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:24 smithi111 docker[31763]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a 2024-02-22T18:59:24.771 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:24 smithi111 bash[28484]: (process:1): GLib-GObject-CRITICAL **: 18:59:24.730: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T18:59:25.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:25 smithi040 bash[13988]: cluster 2024-02-22T18:59:24.130165+0000 mgr.y (mgr.24850) 10 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 517 B/s rd, 0 op/s 2024-02-22T18:59:25.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:25 smithi040 bash[17964]: cluster 2024-02-22T18:59:24.130165+0000 mgr.y (mgr.24850) 10 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 517 B/s rd, 0 op/s 2024-02-22T18:59:25.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:25 smithi111 bash[14162]: cluster 2024-02-22T18:59:24.130165+0000 mgr.y (mgr.24850) 10 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 517 B/s rd, 0 op/s 2024-02-22T18:59:25.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:25 smithi111 bash[31803]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T18:59:25.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:25 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Succeeded. 2024-02-22T18:59:25.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:25 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:59:25.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:25 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Found left-over process 28484 (docker) in control group while starting unit. Ignoring. 2024-02-22T18:59:25.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:25 smithi111 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-22T18:59:25.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:25 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:59:26.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[13988]: audit 2024-02-22T18:59:25.316099+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:26.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[13988]: audit 2024-02-22T18:59:25.327499+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:59:26.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[13988]: audit 2024-02-22T18:59:25.329146+0000 mgr.y (mgr.24850) 11 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:59:26.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[13988]: audit 2024-02-22T18:59:25.339874+0000 mon.c (mon.1) 106 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:59:26.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[13988]: audit 2024-02-22T18:59:25.340986+0000 mgr.y (mgr.24850) 12 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:59:26.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[13988]: audit 2024-02-22T18:59:25.348096+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:59:26.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[17964]: audit 2024-02-22T18:59:25.316099+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:26.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[17964]: audit 2024-02-22T18:59:25.327499+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:59:26.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[17964]: audit 2024-02-22T18:59:25.329146+0000 mgr.y (mgr.24850) 11 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:59:26.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[17964]: audit 2024-02-22T18:59:25.339874+0000 mon.c (mon.1) 106 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:59:26.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[17964]: audit 2024-02-22T18:59:25.340986+0000 mgr.y (mgr.24850) 12 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:59:26.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:26 smithi040 bash[17964]: audit 2024-02-22T18:59:25.348096+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:59:26.696 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:26 smithi111 bash[14162]: audit 2024-02-22T18:59:25.316099+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:26.696 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:26 smithi111 bash[14162]: audit 2024-02-22T18:59:25.327499+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:59:26.696 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:26 smithi111 bash[14162]: audit 2024-02-22T18:59:25.329146+0000 mgr.y (mgr.24850) 11 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T18:59:26.696 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:26 smithi111 bash[14162]: audit 2024-02-22T18:59:25.339874+0000 mon.c (mon.1) 106 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:59:26.696 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:26 smithi111 bash[14162]: audit 2024-02-22T18:59:25.340986+0000 mgr.y (mgr.24850) 12 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T18:59:26.696 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:26 smithi111 bash[14162]: audit 2024-02-22T18:59:25.348096+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T18:59:26.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:26 smithi111 bash[31860]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T18:59:27.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:27 smithi040 bash[13988]: cluster 2024-02-22T18:59:26.131654+0000 mgr.y (mgr.24850) 13 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 947 B/s rd, 1 op/s 2024-02-22T18:59:27.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:27 smithi040 bash[17964]: cluster 2024-02-22T18:59:26.131654+0000 mgr.y (mgr.24850) 13 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 947 B/s rd, 1 op/s 2024-02-22T18:59:27.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[14162]: cluster 2024-02-22T18:59:26.131654+0000 mgr.y (mgr.24850) 13 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 947 B/s rd, 1 op/s 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: --- Logging error --- 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.send(msg) 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.connect(address) 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self._connect_unixsocket(self.address) 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.connect(address) 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Call stack: 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self._bootstrap_inner() 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.run() 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: logger.info("Started the configuration object watcher") 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Message: 'Started the configuration object watcher' 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Arguments: () 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: --- Logging error --- 2024-02-22T18:59:28.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.send(msg) 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.connect(address) 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self._connect_unixsocket(self.address) 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.connect(address) 2024-02-22T18:59:28.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:28.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Call stack: 2024-02-22T18:59:28.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:28.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: main() 2024-02-22T18:59:28.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:59:28.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:59:28.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T18:59:28.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T18:59:28.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Arguments: () 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: --- Logging error --- 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.send(msg) 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.connect(address) 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self._connect_unixsocket(self.address) 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.connect(address) 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Call stack: 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self._bootstrap_inner() 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.run() 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.interval)) 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Message: 'Checking for config object changes every 1s' 2024-02-22T18:59:28.222 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Arguments: () 2024-02-22T18:59:28.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: --- Logging error --- 2024-02-22T18:59:28.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:28.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.send(msg) 2024-02-22T18:59:28.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:28.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:28.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:28.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.connect(address) 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self._connect_unixsocket(self.address) 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: self.socket.connect(address) 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Call stack: 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: main() 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:59:28.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T18:59:28.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T18:59:28.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T18:59:28.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: "{}".format(blacklisted_ip)) 2024-02-22T18:59:28.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/18122890' 2024-02-22T18:59:28.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Arguments: () 2024-02-22T18:59:28.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: Traceback (most recent call last): 2024-02-22T18:59:28.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:28.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: main() 2024-02-22T18:59:28.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: **kwargs).stdout 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: output=stdout, stderr=stderr) 2024-02-22T18:59:28.226 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:27 smithi111 bash[31877]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/18122890' returned non-zero exit status 13. 2024-02-22T18:59:28.622 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:28 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T18:59:28.622 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:28 smithi111 bash[14162]: audit 2024-02-22T18:59:27.374366+0000 mon.b (mon.2) 37 : audit [DBG] from='client.? 172.21.15.111:0/93802102' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:59:28.622 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:28 smithi111 bash[14162]: audit 2024-02-22T18:59:27.706471+0000 mon.b (mon.2) 38 : audit [INF] from='client.? 172.21.15.111:0/208088698' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T18:59:28.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:28 smithi040 bash[13988]: audit 2024-02-22T18:59:27.374366+0000 mon.b (mon.2) 37 : audit [DBG] from='client.? 172.21.15.111:0/93802102' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:59:28.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:28 smithi040 bash[13988]: audit 2024-02-22T18:59:27.706471+0000 mon.b (mon.2) 38 : audit [INF] from='client.? 172.21.15.111:0/208088698' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T18:59:28.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:28 smithi040 bash[17964]: audit 2024-02-22T18:59:27.374366+0000 mon.b (mon.2) 37 : audit [DBG] from='client.? 172.21.15.111:0/93802102' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:59:28.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:28 smithi040 bash[17964]: audit 2024-02-22T18:59:27.706471+0000 mon.b (mon.2) 38 : audit [INF] from='client.? 172.21.15.111:0/208088698' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T18:59:28.965 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:28 smithi111 bash[31860]: (process:1): GLib-GObject-CRITICAL **: 18:59:28.618: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T18:59:29.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:29 smithi111 bash[32109]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T18:59:29.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:29 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T18:59:29.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:29 smithi040 bash[13988]: cluster 2024-02-22T18:59:28.132541+0000 mgr.y (mgr.24850) 14 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-02-22T18:59:29.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:29 smithi040 bash[17964]: cluster 2024-02-22T18:59:28.132541+0000 mgr.y (mgr.24850) 14 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-02-22T18:59:29.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:29 smithi111 bash[14162]: cluster 2024-02-22T18:59:28.132541+0000 mgr.y (mgr.24850) 14 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-02-22T18:59:31.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:31 smithi040 bash[13988]: cluster 2024-02-22T18:59:30.134107+0000 mgr.y (mgr.24850) 15 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-02-22T18:59:31.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:31 smithi040 bash[17964]: cluster 2024-02-22T18:59:30.134107+0000 mgr.y (mgr.24850) 15 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-02-22T18:59:31.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:31 smithi111 bash[14162]: cluster 2024-02-22T18:59:30.134107+0000 mgr.y (mgr.24850) 15 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-02-22T18:59:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:31.636Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:31.636Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:31 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:31.636Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:59:33.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[13988]: cluster 2024-02-22T18:59:32.134842+0000 mgr.y (mgr.24850) 16 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-02-22T18:59:33.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[13988]: audit 2024-02-22T18:59:32.867312+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:33.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[13988]: audit 2024-02-22T18:59:32.870207+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:59:33.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[13988]: audit 2024-02-22T18:59:32.872013+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:59:33.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[13988]: audit 2024-02-22T18:59:32.881943+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:33.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[17964]: cluster 2024-02-22T18:59:32.134842+0000 mgr.y (mgr.24850) 16 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-02-22T18:59:33.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[17964]: audit 2024-02-22T18:59:32.867312+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:33.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[17964]: audit 2024-02-22T18:59:32.870207+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:59:33.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[17964]: audit 2024-02-22T18:59:32.872013+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:59:33.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[17964]: audit 2024-02-22T18:59:32.881943+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:33.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:33 smithi111 bash[14162]: cluster 2024-02-22T18:59:32.134842+0000 mgr.y (mgr.24850) 16 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-02-22T18:59:33.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:33 smithi111 bash[14162]: audit 2024-02-22T18:59:32.867312+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:33.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:33 smithi111 bash[14162]: audit 2024-02-22T18:59:32.870207+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T18:59:33.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:33 smithi111 bash[14162]: audit 2024-02-22T18:59:32.872013+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T18:59:33.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:33 smithi111 bash[14162]: audit 2024-02-22T18:59:32.881943+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T18:59:33.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:33.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:33.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:33.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:33.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:33 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:33.523Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:59:34.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:34 smithi040 bash[13988]: cephadm 2024-02-22T18:59:32.873585+0000 mgr.y (mgr.24850) 17 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:59:34.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:34 smithi040 bash[13988]: cluster 2024-02-22T18:59:32.875002+0000 mgr.y (mgr.24850) 18 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 667 B/s rd, 0 op/s 2024-02-22T18:59:34.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:34 smithi040 bash[13988]: cluster 2024-02-22T18:59:33.106539+0000 mon.a (mon.0) 919 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T18:59:34.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:34 smithi040 bash[17964]: cephadm 2024-02-22T18:59:32.873585+0000 mgr.y (mgr.24850) 17 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:59:34.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:34 smithi040 bash[17964]: cluster 2024-02-22T18:59:32.875002+0000 mgr.y (mgr.24850) 18 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 667 B/s rd, 0 op/s 2024-02-22T18:59:34.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:34 smithi040 bash[17964]: cluster 2024-02-22T18:59:33.106539+0000 mon.a (mon.0) 919 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T18:59:34.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:34 smithi111 bash[14162]: cephadm 2024-02-22T18:59:32.873585+0000 mgr.y (mgr.24850) 17 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T18:59:34.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:34 smithi111 bash[14162]: cluster 2024-02-22T18:59:32.875002+0000 mgr.y (mgr.24850) 18 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 667 B/s rd, 0 op/s 2024-02-22T18:59:34.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:34 smithi111 bash[14162]: cluster 2024-02-22T18:59:33.106539+0000 mon.a (mon.0) 919 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T18:59:36.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:36 smithi040 bash[13988]: cluster 2024-02-22T18:59:34.876548+0000 mgr.y (mgr.24850) 19 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 667 B/s rd, 0 op/s 2024-02-22T18:59:36.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:36 smithi040 bash[17964]: cluster 2024-02-22T18:59:34.876548+0000 mgr.y (mgr.24850) 19 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 667 B/s rd, 0 op/s 2024-02-22T18:59:36.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:36 smithi111 bash[14162]: cluster 2024-02-22T18:59:34.876548+0000 mgr.y (mgr.24850) 19 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 667 B/s rd, 0 op/s 2024-02-22T18:59:38.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:38 smithi040 bash[17964]: cluster 2024-02-22T18:59:36.877282+0000 mgr.y (mgr.24850) 20 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 95 B/s rd, 0 op/s 2024-02-22T18:59:38.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:38 smithi040 bash[13988]: cluster 2024-02-22T18:59:36.877282+0000 mgr.y (mgr.24850) 20 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 95 B/s rd, 0 op/s 2024-02-22T18:59:38.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:38 smithi111 bash[14162]: cluster 2024-02-22T18:59:36.877282+0000 mgr.y (mgr.24850) 20 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 95 B/s rd, 0 op/s 2024-02-22T18:59:39.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:39 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 1. 2024-02-22T18:59:39.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:39 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:59:39.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:39 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:59:40.427 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:40 smithi111 bash[14162]: cluster 2024-02-22T18:59:38.878056+0000 mgr.y (mgr.24850) 21 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 95 B/s rd, 0 op/s 2024-02-22T18:59:40.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:40 smithi040 bash[13988]: cluster 2024-02-22T18:59:38.878056+0000 mgr.y (mgr.24850) 21 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 95 B/s rd, 0 op/s 2024-02-22T18:59:40.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:40 smithi040 bash[17964]: cluster 2024-02-22T18:59:38.878056+0000 mgr.y (mgr.24850) 21 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 95 B/s rd, 0 op/s 2024-02-22T18:59:40.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:40 smithi111 bash[32748]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T18:59:41.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:41 smithi040 bash[13988]: audit 2024-02-22T18:59:41.102516+0000 mon.b (mon.2) 39 : audit [DBG] from='client.? 172.21.15.111:0/2645760158' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:59:41.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:41 smithi040 bash[17964]: audit 2024-02-22T18:59:41.102516+0000 mon.b (mon.2) 39 : audit [DBG] from='client.? 172.21.15.111:0/2645760158' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:59:41.445 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[14162]: audit 2024-02-22T18:59:41.102516+0000 mon.b (mon.2) 39 : audit [DBG] from='client.? 172.21.15.111:0/2645760158' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:59:41.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: --- Logging error --- 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.send(msg) 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.connect(address) 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self._connect_unixsocket(self.address) 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.connect(address) 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Call stack: 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self._bootstrap_inner() 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.run() 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: logger.info("Started the configuration object watcher") 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Message: 'Started the configuration object watcher' 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Arguments: () 2024-02-22T18:59:41.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: --- Logging error --- 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.send(msg) 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.connect(address) 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self._connect_unixsocket(self.address) 2024-02-22T18:59:41.719 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:41.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.connect(address) 2024-02-22T18:59:41.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:41.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Call stack: 2024-02-22T18:59:41.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:41.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: main() 2024-02-22T18:59:41.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:59:41.720 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Arguments: () 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: --- Logging error --- 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.send(msg) 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.connect(address) 2024-02-22T18:59:41.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self._connect_unixsocket(self.address) 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.connect(address) 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Call stack: 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self._bootstrap_inner() 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.run() 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.interval)) 2024-02-22T18:59:41.722 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Message: 'Checking for config object changes every 1s' 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Arguments: () 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: --- Logging error --- 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.send(msg) 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.connect(address) 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:41.723 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self._connect_unixsocket(self.address) 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: self.socket.connect(address) 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Call stack: 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: main() 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: "{}".format(blacklisted_ip)) 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/18122890' 2024-02-22T18:59:41.724 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Arguments: () 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: Traceback (most recent call last): 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: main() 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: **kwargs).stdout 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T18:59:41.725 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: output=stdout, stderr=stderr) 2024-02-22T18:59:41.726 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:41 smithi111 bash[32764]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/18122890' returned non-zero exit status 13. 2024-02-22T18:59:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:41.637Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:41.637Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:41 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:41.637Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:59:42.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:42 smithi040 bash[13988]: cluster 2024-02-22T18:59:40.879562+0000 mgr.y (mgr.24850) 22 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:42.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:42 smithi040 bash[13988]: audit 2024-02-22T18:59:41.437271+0000 mon.b (mon.2) 40 : audit [INF] from='client.? 172.21.15.111:0/2669415801' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T18:59:42.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:42 smithi040 bash[17964]: cluster 2024-02-22T18:59:40.879562+0000 mgr.y (mgr.24850) 22 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:42.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:42 smithi040 bash[17964]: audit 2024-02-22T18:59:41.437271+0000 mon.b (mon.2) 40 : audit [INF] from='client.? 172.21.15.111:0/2669415801' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T18:59:42.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:42 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T18:59:42.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:42 smithi111 bash[32748]: (process:1): GLib-GObject-CRITICAL **: 18:59:42.304: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T18:59:42.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:42 smithi111 bash[14162]: cluster 2024-02-22T18:59:40.879562+0000 mgr.y (mgr.24850) 22 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:42.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:42 smithi111 bash[14162]: audit 2024-02-22T18:59:41.437271+0000 mon.b (mon.2) 40 : audit [INF] from='client.? 172.21.15.111:0/2669415801' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T18:59:43.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:42 smithi111 bash[32977]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T18:59:43.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:42 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T18:59:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:43.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:43.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:43 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:43.523Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:59:44.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:44 smithi040 bash[13988]: cluster 2024-02-22T18:59:42.880344+0000 mgr.y (mgr.24850) 23 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:44.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:44 smithi040 bash[17964]: cluster 2024-02-22T18:59:42.880344+0000 mgr.y (mgr.24850) 23 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:44.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:44 smithi111 bash[14162]: cluster 2024-02-22T18:59:42.880344+0000 mgr.y (mgr.24850) 23 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:46.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:46 smithi040 bash[13988]: cluster 2024-02-22T18:59:44.881793+0000 mgr.y (mgr.24850) 24 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:46.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:46 smithi040 bash[17964]: cluster 2024-02-22T18:59:44.881793+0000 mgr.y (mgr.24850) 24 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:46.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:46 smithi111 bash[14162]: cluster 2024-02-22T18:59:44.881793+0000 mgr.y (mgr.24850) 24 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:48.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:48 smithi040 bash[17964]: cluster 2024-02-22T18:59:46.882560+0000 mgr.y (mgr.24850) 25 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:48.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:48 smithi040 bash[13988]: cluster 2024-02-22T18:59:46.882560+0000 mgr.y (mgr.24850) 25 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:48.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:48 smithi111 bash[14162]: cluster 2024-02-22T18:59:46.882560+0000 mgr.y (mgr.24850) 25 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:50.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:50 smithi040 bash[13988]: cluster 2024-02-22T18:59:48.883320+0000 mgr.y (mgr.24850) 26 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:50.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:50 smithi040 bash[17964]: cluster 2024-02-22T18:59:48.883320+0000 mgr.y (mgr.24850) 26 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:50.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:50 smithi111 bash[14162]: cluster 2024-02-22T18:59:48.883320+0000 mgr.y (mgr.24850) 26 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:51.637Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:51.637Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:51 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:51.637Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T18:59:52.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:52 smithi040 bash[13988]: cluster 2024-02-22T18:59:50.884991+0000 mgr.y (mgr.24850) 27 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:52.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:52 smithi040 bash[17964]: cluster 2024-02-22T18:59:50.884991+0000 mgr.y (mgr.24850) 27 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:52 smithi111 bash[14162]: cluster 2024-02-22T18:59:50.884991+0000 mgr.y (mgr.24850) 27 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:53.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:52 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 2. 2024-02-22T18:59:53.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:52 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:59:53.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:52 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T18:59:53.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:53.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T18:59:53.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:53.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T18:59:53.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 18:59:53 smithi040 bash[29235]: level=error ts=2024-02-22T18:59:53.524Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T18:59:54.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:54 smithi111 bash[14162]: cluster 2024-02-22T18:59:52.885906+0000 mgr.y (mgr.24850) 28 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:54.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:54 smithi111 bash[33038]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T18:59:54.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:54 smithi040 bash[13988]: cluster 2024-02-22T18:59:52.885906+0000 mgr.y (mgr.24850) 28 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:54.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:54 smithi040 bash[17964]: cluster 2024-02-22T18:59:52.885906+0000 mgr.y (mgr.24850) 28 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:55.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[14162]: audit 2024-02-22T18:59:54.844778+0000 mon.b (mon.2) 41 : audit [DBG] from='client.? 172.21.15.111:0/2669382818' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:59:55.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[14162]: audit 2024-02-22T18:59:55.176753+0000 mon.b (mon.2) 42 : audit [INF] from='client.? 172.21.15.111:0/2482315566' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T18:59:55.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: --- Logging error --- 2024-02-22T18:59:55.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.send(msg) 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.connect(address) 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self._connect_unixsocket(self.address) 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.connect(address) 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:55.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Call stack: 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self._bootstrap_inner() 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.run() 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: logger.info("Started the configuration object watcher") 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Message: 'Started the configuration object watcher' 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Arguments: () 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: --- Logging error --- 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.send(msg) 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:55.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.connect(address) 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self._connect_unixsocket(self.address) 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.connect(address) 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Call stack: 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:55.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: main() 2024-02-22T18:59:55.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:59:55.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:59:55.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T18:59:55.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T18:59:55.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T18:59:55.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Arguments: () 2024-02-22T18:59:55.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: --- Logging error --- 2024-02-22T18:59:55.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.send(msg) 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.connect(address) 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self._connect_unixsocket(self.address) 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.connect(address) 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Call stack: 2024-02-22T18:59:55.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self._bootstrap_inner() 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.run() 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.interval)) 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Message: 'Checking for config object changes every 1s' 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Arguments: () 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: --- Logging error --- 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.send(msg) 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: OSError: [Errno 9] Bad file descriptor 2024-02-22T18:59:55.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.connect(address) 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: During handling of the above exception, another exception occurred: 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self._connect_unixsocket(self.address) 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: self.socket.connect(address) 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Call stack: 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: main() 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:59:55.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: "{}".format(blacklisted_ip)) 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/18122890' 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Arguments: () 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: Traceback (most recent call last): 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: main() 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T18:59:55.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T18:59:55.475 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T18:59:55.475 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T18:59:55.475 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: **kwargs).stdout 2024-02-22T18:59:55.475 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T18:59:55.475 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: output=stdout, stderr=stderr) 2024-02-22T18:59:55.475 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 bash[33055]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/18122890' returned non-zero exit status 13. 2024-02-22T18:59:55.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:55 smithi040 bash[13988]: audit 2024-02-22T18:59:54.844778+0000 mon.b (mon.2) 41 : audit [DBG] from='client.? 172.21.15.111:0/2669382818' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:59:55.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:55 smithi040 bash[13988]: audit 2024-02-22T18:59:55.176753+0000 mon.b (mon.2) 42 : audit [INF] from='client.? 172.21.15.111:0/2482315566' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T18:59:55.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:55 smithi040 bash[17964]: audit 2024-02-22T18:59:54.844778+0000 mon.b (mon.2) 41 : audit [DBG] from='client.? 172.21.15.111:0/2669382818' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T18:59:55.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:55 smithi040 bash[17964]: audit 2024-02-22T18:59:55.176753+0000 mon.b (mon.2) 42 : audit [INF] from='client.? 172.21.15.111:0/2482315566' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T18:59:56.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:56 smithi111 bash[14162]: cluster 2024-02-22T18:59:54.887549+0000 mgr.y (mgr.24850) 29 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:56.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:55 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T18:59:56.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:56 smithi111 bash[33038]: (process:1): GLib-GObject-CRITICAL **: 18:59:56.030: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T18:59:56.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:56 smithi040 bash[13988]: cluster 2024-02-22T18:59:54.887549+0000 mgr.y (mgr.24850) 29 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:56 smithi040 bash[17964]: cluster 2024-02-22T18:59:54.887549+0000 mgr.y (mgr.24850) 29 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T18:59:56.965 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:56 smithi111 bash[33266]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T18:59:56.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 18:59:56 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T18:59:58.468 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 18:59:58 smithi111 bash[14162]: cluster 2024-02-22T18:59:56.888368+0000 mgr.y (mgr.24850) 30 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:58.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 18:59:58 smithi040 bash[13988]: cluster 2024-02-22T18:59:56.888368+0000 mgr.y (mgr.24850) 30 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T18:59:58.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 18:59:58 smithi040 bash[17964]: cluster 2024-02-22T18:59:56.888368+0000 mgr.y (mgr.24850) 30 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:00.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:00 smithi111 bash[14162]: cluster 2024-02-22T18:59:58.889101+0000 mgr.y (mgr.24850) 31 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:00.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:00 smithi111 bash[14162]: cluster 2024-02-22T19:00:00.000134+0000 mon.a (mon.0) 920 : cluster [WRN] Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-02-22T19:00:00.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:00 smithi111 bash[14162]: cluster 2024-02-22T19:00:00.000194+0000 mon.a (mon.0) 921 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-02-22T19:00:00.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:00 smithi111 bash[14162]: cluster 2024-02-22T19:00:00.000303+0000 mon.a (mon.0) 922 : cluster [WRN] daemon iscsi.iscsi.a on smithi111 is in error state 2024-02-22T19:00:00.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:00 smithi040 bash[17964]: cluster 2024-02-22T18:59:58.889101+0000 mgr.y (mgr.24850) 31 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:00.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:00 smithi040 bash[17964]: cluster 2024-02-22T19:00:00.000134+0000 mon.a (mon.0) 920 : cluster [WRN] Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-02-22T19:00:00.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:00 smithi040 bash[17964]: cluster 2024-02-22T19:00:00.000194+0000 mon.a (mon.0) 921 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-02-22T19:00:00.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:00 smithi040 bash[17964]: cluster 2024-02-22T19:00:00.000303+0000 mon.a (mon.0) 922 : cluster [WRN] daemon iscsi.iscsi.a on smithi111 is in error state 2024-02-22T19:00:00.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:00 smithi040 bash[13988]: cluster 2024-02-22T18:59:58.889101+0000 mgr.y (mgr.24850) 31 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:00.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:00 smithi040 bash[13988]: cluster 2024-02-22T19:00:00.000134+0000 mon.a (mon.0) 920 : cluster [WRN] Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-02-22T19:00:00.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:00 smithi040 bash[13988]: cluster 2024-02-22T19:00:00.000194+0000 mon.a (mon.0) 921 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-02-22T19:00:00.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:00 smithi040 bash[13988]: cluster 2024-02-22T19:00:00.000303+0000 mon.a (mon.0) 922 : cluster [WRN] daemon iscsi.iscsi.a on smithi111 is in error state 2024-02-22T19:00:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:01.637Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:01.637Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:01.637Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:00:02.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:02 smithi111 bash[14162]: cluster 2024-02-22T19:00:00.890629+0000 mgr.y (mgr.24850) 32 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:02.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:02 smithi040 bash[13988]: cluster 2024-02-22T19:00:00.890629+0000 mgr.y (mgr.24850) 32 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:02.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:02 smithi040 bash[17964]: cluster 2024-02-22T19:00:00.890629+0000 mgr.y (mgr.24850) 32 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:03.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:03 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:03.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:03.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:03 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:03.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:03.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:03 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:03.524Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:00:04.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:04 smithi040 bash[13988]: cluster 2024-02-22T19:00:02.891374+0000 mgr.y (mgr.24850) 33 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:04.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:04 smithi040 bash[17964]: cluster 2024-02-22T19:00:02.891374+0000 mgr.y (mgr.24850) 33 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:04.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:04 smithi111 bash[14162]: cluster 2024-02-22T19:00:02.891374+0000 mgr.y (mgr.24850) 33 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:06.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:06 smithi040 bash[13988]: cluster 2024-02-22T19:00:04.892919+0000 mgr.y (mgr.24850) 34 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:06.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:06 smithi040 bash[17964]: cluster 2024-02-22T19:00:04.892919+0000 mgr.y (mgr.24850) 34 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:06.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:06 smithi111 bash[14162]: cluster 2024-02-22T19:00:04.892919+0000 mgr.y (mgr.24850) 34 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:07.215 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:06 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 3. 2024-02-22T19:00:07.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:06 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:00:07.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:06 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:00:08.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:08 smithi111 bash[14162]: cluster 2024-02-22T19:00:06.893641+0000 mgr.y (mgr.24850) 35 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:08.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:08 smithi111 bash[33329]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T19:00:08.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:08 smithi040 bash[13988]: cluster 2024-02-22T19:00:06.893641+0000 mgr.y (mgr.24850) 35 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:08 smithi040 bash[17964]: cluster 2024-02-22T19:00:06.893641+0000 mgr.y (mgr.24850) 35 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:09.265 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[14162]: audit 2024-02-22T19:00:08.664236+0000 mon.b (mon.2) 43 : audit [DBG] from='client.? 172.21.15.111:0/2341607481' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:00:09.265 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[14162]: audit 2024-02-22T19:00:08.996288+0000 mon.b (mon.2) 44 : audit [INF] from='client.? 172.21.15.111:0/1222750043' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: --- Logging error --- 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.send(msg) 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.connect(address) 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:09.266 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self._connect_unixsocket(self.address) 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.connect(address) 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Call stack: 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self._bootstrap_inner() 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.run() 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: logger.info("Started the configuration object watcher") 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Message: 'Started the configuration object watcher' 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Arguments: () 2024-02-22T19:00:09.267 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: --- Logging error --- 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.send(msg) 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.connect(address) 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self._connect_unixsocket(self.address) 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:00:09.268 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.connect(address) 2024-02-22T19:00:09.269 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:09.269 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Call stack: 2024-02-22T19:00:09.269 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:00:09.269 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: main() 2024-02-22T19:00:09.269 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:00:09.269 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:00:09.269 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Arguments: () 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: --- Logging error --- 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.send(msg) 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.connect(address) 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.270 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self._connect_unixsocket(self.address) 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.connect(address) 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Call stack: 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self._bootstrap_inner() 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.run() 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.interval)) 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Message: 'Checking for config object changes every 1s' 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Arguments: () 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: --- Logging error --- 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.271 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.send(msg) 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.connect(address) 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self._connect_unixsocket(self.address) 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: self.socket.connect(address) 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:09.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Call stack: 2024-02-22T19:00:09.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:00:09.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: main() 2024-02-22T19:00:09.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:00:09.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:00:09.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:00:09.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:00:09.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T19:00:09.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: "{}".format(blacklisted_ip)) 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/18122890' 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Arguments: () 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: Traceback (most recent call last): 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: main() 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: **kwargs).stdout 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: output=stdout, stderr=stderr) 2024-02-22T19:00:09.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33347]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/18122890' returned non-zero exit status 13. 2024-02-22T19:00:09.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:09 smithi040 bash[13988]: audit 2024-02-22T19:00:08.664236+0000 mon.b (mon.2) 43 : audit [DBG] from='client.? 172.21.15.111:0/2341607481' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:00:09.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:09 smithi040 bash[13988]: audit 2024-02-22T19:00:08.996288+0000 mon.b (mon.2) 44 : audit [INF] from='client.? 172.21.15.111:0/1222750043' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T19:00:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:09 smithi040 bash[17964]: audit 2024-02-22T19:00:08.664236+0000 mon.b (mon.2) 43 : audit [DBG] from='client.? 172.21.15.111:0/2341607481' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:00:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:09 smithi040 bash[17964]: audit 2024-02-22T19:00:08.996288+0000 mon.b (mon.2) 44 : audit [INF] from='client.? 172.21.15.111:0/1222750043' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T19:00:09.965 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:00:09.965 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:09 smithi111 bash[33329]: (process:1): GLib-GObject-CRITICAL **: 19:00:09.793: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T19:00:10.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:10 smithi111 bash[14162]: cluster 2024-02-22T19:00:08.894392+0000 mgr.y (mgr.24850) 36 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:10.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:10 smithi040 bash[13988]: cluster 2024-02-22T19:00:08.894392+0000 mgr.y (mgr.24850) 36 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:10.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:10 smithi040 bash[17964]: cluster 2024-02-22T19:00:08.894392+0000 mgr.y (mgr.24850) 36 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:10.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:10 smithi111 bash[33561]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T19:00:10.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:10 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:00:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:11.638Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:11.638Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:11.638Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:00:12.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:12 smithi040 bash[17964]: cluster 2024-02-22T19:00:10.895872+0000 mgr.y (mgr.24850) 37 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-22T19:00:12.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:12 smithi040 bash[13988]: cluster 2024-02-22T19:00:10.895872+0000 mgr.y (mgr.24850) 37 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-22T19:00:12.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:12 smithi111 bash[14162]: cluster 2024-02-22T19:00:10.895872+0000 mgr.y (mgr.24850) 37 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-22T19:00:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:13 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:13.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:13 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:13.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:13.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:13 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:13.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:00:14.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[17964]: cluster 2024-02-22T19:00:12.896663+0000 mgr.y (mgr.24850) 38 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:14.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[17964]: audit 2024-02-22T19:00:14.185327+0000 mon.c (mon.1) 110 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[17964]: audit 2024-02-22T19:00:14.185967+0000 mon.c (mon.1) 111 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[17964]: audit 2024-02-22T19:00:14.186244+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[17964]: audit 2024-02-22T19:00:14.186730+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[17964]: audit 2024-02-22T19:00:14.187208+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[17964]: audit 2024-02-22T19:00:14.188480+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[13988]: cluster 2024-02-22T19:00:12.896663+0000 mgr.y (mgr.24850) 38 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[13988]: audit 2024-02-22T19:00:14.185327+0000 mon.c (mon.1) 110 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[13988]: audit 2024-02-22T19:00:14.185967+0000 mon.c (mon.1) 111 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[13988]: audit 2024-02-22T19:00:14.186244+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[13988]: audit 2024-02-22T19:00:14.186730+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-22T19:00:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[13988]: audit 2024-02-22T19:00:14.187208+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:14 smithi040 bash[13988]: audit 2024-02-22T19:00:14.188480+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-22T19:00:14.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:14 smithi111 bash[14162]: cluster 2024-02-22T19:00:12.896663+0000 mgr.y (mgr.24850) 38 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:14 smithi111 bash[14162]: audit 2024-02-22T19:00:14.185327+0000 mon.c (mon.1) 110 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:14 smithi111 bash[14162]: audit 2024-02-22T19:00:14.185967+0000 mon.c (mon.1) 111 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:14 smithi111 bash[14162]: audit 2024-02-22T19:00:14.186244+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:14 smithi111 bash[14162]: audit 2024-02-22T19:00:14.186730+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-22T19:00:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:14 smithi111 bash[14162]: audit 2024-02-22T19:00:14.187208+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:00:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:14 smithi111 bash[14162]: audit 2024-02-22T19:00:14.188480+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-22T19:00:16.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:16 smithi040 bash[17964]: cluster 2024-02-22T19:00:14.898423+0000 mgr.y (mgr.24850) 39 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:16.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:16 smithi040 bash[13988]: cluster 2024-02-22T19:00:14.898423+0000 mgr.y (mgr.24850) 39 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:16.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:16 smithi111 bash[14162]: cluster 2024-02-22T19:00:14.898423+0000 mgr.y (mgr.24850) 39 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:18 smithi040 bash[13988]: cluster 2024-02-22T19:00:16.899219+0000 mgr.y (mgr.24850) 40 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:18.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:18 smithi040 bash[17964]: cluster 2024-02-22T19:00:16.899219+0000 mgr.y (mgr.24850) 40 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:18.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:18 smithi111 bash[14162]: cluster 2024-02-22T19:00:16.899219+0000 mgr.y (mgr.24850) 40 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:20.526 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:20 smithi111 bash[14162]: cluster 2024-02-22T19:00:18.899952+0000 mgr.y (mgr.24850) 41 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:20.527 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:20 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 4. 2024-02-22T19:00:20.527 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:20 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:00:20.527 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:20 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:00:20.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:20 smithi040 bash[13988]: cluster 2024-02-22T19:00:18.899952+0000 mgr.y (mgr.24850) 41 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:20.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:20 smithi040 bash[17964]: cluster 2024-02-22T19:00:18.899952+0000 mgr.y (mgr.24850) 41 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:21.638Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:21.638Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:21.638Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:00:22.215 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:21 smithi111 bash[33621]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T19:00:22.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:22 smithi040 bash[13988]: cluster 2024-02-22T19:00:20.901479+0000 mgr.y (mgr.24850) 42 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:22.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:22 smithi040 bash[17964]: cluster 2024-02-22T19:00:20.901479+0000 mgr.y (mgr.24850) 42 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:22.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[14162]: cluster 2024-02-22T19:00:20.901479+0000 mgr.y (mgr.24850) 42 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:23.081 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: --- Logging error --- 2024-02-22T19:00:23.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:00:23.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.send(msg) 2024-02-22T19:00:23.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:00:23.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:23.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:00:23.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.connect(address) 2024-02-22T19:00:23.082 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self._connect_unixsocket(self.address) 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.connect(address) 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Call stack: 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self._bootstrap_inner() 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.run() 2024-02-22T19:00:23.083 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: logger.info("Started the configuration object watcher") 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Message: 'Started the configuration object watcher' 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Arguments: () 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: --- Logging error --- 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.send(msg) 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:00:23.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.connect(address) 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self._connect_unixsocket(self.address) 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.connect(address) 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Call stack: 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: main() 2024-02-22T19:00:23.085 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:00:23.086 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:00:23.086 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T19:00:23.086 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T19:00:23.086 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T19:00:23.087 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Arguments: () 2024-02-22T19:00:23.087 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: --- Logging error --- 2024-02-22T19:00:23.087 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.087 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:00:23.087 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.send(msg) 2024-02-22T19:00:23.087 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:00:23.087 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:23.087 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.connect(address) 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self._connect_unixsocket(self.address) 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.connect(address) 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:23.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Call stack: 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self._bootstrap_inner() 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.run() 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.interval)) 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Message: 'Checking for config object changes every 1s' 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Arguments: () 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: --- Logging error --- 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.send(msg) 2024-02-22T19:00:23.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.connect(address) 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: During handling of the above exception, another exception occurred: 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self._connect_unixsocket(self.address) 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: self.socket.connect(address) 2024-02-22T19:00:23.090 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Call stack: 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: main() 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: "{}".format(blacklisted_ip)) 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/18122890' 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Arguments: () 2024-02-22T19:00:23.091 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: Traceback (most recent call last): 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: main() 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: **kwargs).stdout 2024-02-22T19:00:23.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T19:00:23.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: output=stdout, stderr=stderr) 2024-02-22T19:00:23.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:22 smithi111 bash[33639]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/18122890' returned non-zero exit status 13. 2024-02-22T19:00:23.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:23 smithi111 bash[14162]: audit 2024-02-22T19:00:22.462123+0000 mon.b (mon.2) 45 : audit [DBG] from='client.? 172.21.15.111:0/1712854361' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:00:23.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:23 smithi111 bash[14162]: audit 2024-02-22T19:00:22.790273+0000 mon.b (mon.2) 46 : audit [INF] from='client.? 172.21.15.111:0/181472684' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T19:00:23.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:23 smithi040 bash[13988]: audit 2024-02-22T19:00:22.462123+0000 mon.b (mon.2) 45 : audit [DBG] from='client.? 172.21.15.111:0/1712854361' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:00:23.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:23 smithi040 bash[13988]: audit 2024-02-22T19:00:22.790273+0000 mon.b (mon.2) 46 : audit [INF] from='client.? 172.21.15.111:0/181472684' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T19:00:23.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:23 smithi040 bash[17964]: audit 2024-02-22T19:00:22.462123+0000 mon.b (mon.2) 45 : audit [DBG] from='client.? 172.21.15.111:0/1712854361' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:00:23.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:23 smithi040 bash[17964]: audit 2024-02-22T19:00:22.790273+0000 mon.b (mon.2) 46 : audit [INF] from='client.? 172.21.15.111:0/181472684' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/18122890"}]: access denied 2024-02-22T19:00:23.681 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:23 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:23.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:23.681 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:23 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:23.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:23.681 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:23 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:23.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:00:23.872 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:23 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:00:23.872 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:23 smithi111 bash[33621]: (process:1): GLib-GObject-CRITICAL **: 19:00:23.677: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T19:00:24.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:24 smithi111 bash[14162]: cluster 2024-02-22T19:00:22.902358+0000 mgr.y (mgr.24850) 43 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:24.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:24 smithi111 bash[33862]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T19:00:24.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:24 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:00:24.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:24 smithi040 bash[13988]: cluster 2024-02-22T19:00:22.902358+0000 mgr.y (mgr.24850) 43 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:24.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:24 smithi040 bash[17964]: cluster 2024-02-22T19:00:22.902358+0000 mgr.y (mgr.24850) 43 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:26.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:26 smithi040 bash[13988]: cluster 2024-02-22T19:00:24.904031+0000 mgr.y (mgr.24850) 44 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:26.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:26 smithi040 bash[17964]: cluster 2024-02-22T19:00:24.904031+0000 mgr.y (mgr.24850) 44 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:26.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:26 smithi111 bash[14162]: cluster 2024-02-22T19:00:24.904031+0000 mgr.y (mgr.24850) 44 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:28.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:28 smithi040 bash[13988]: cluster 2024-02-22T19:00:26.904825+0000 mgr.y (mgr.24850) 45 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:28.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:28 smithi040 bash[17964]: cluster 2024-02-22T19:00:26.904825+0000 mgr.y (mgr.24850) 45 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:28.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:28 smithi111 bash[14162]: cluster 2024-02-22T19:00:26.904825+0000 mgr.y (mgr.24850) 45 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:30.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:30 smithi040 bash[13988]: cluster 2024-02-22T19:00:28.905507+0000 mgr.y (mgr.24850) 46 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:30.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:30 smithi040 bash[17964]: cluster 2024-02-22T19:00:28.905507+0000 mgr.y (mgr.24850) 46 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:30.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:30 smithi111 bash[14162]: cluster 2024-02-22T19:00:28.905507+0000 mgr.y (mgr.24850) 46 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:31.639Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:31.639Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:31.639Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:00:32.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:32 smithi040 bash[17964]: cluster 2024-02-22T19:00:30.907001+0000 mgr.y (mgr.24850) 47 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:32.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:32 smithi040 bash[13988]: cluster 2024-02-22T19:00:30.907001+0000 mgr.y (mgr.24850) 47 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:32.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:32 smithi111 bash[14162]: cluster 2024-02-22T19:00:30.907001+0000 mgr.y (mgr.24850) 47 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:33.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:33 smithi040 bash[13988]: audit 2024-02-22T19:00:33.187820+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:00:33.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:33 smithi040 bash[13988]: audit 2024-02-22T19:00:33.189629+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:00:33.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:33 smithi040 bash[13988]: audit 2024-02-22T19:00:33.200850+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T19:00:33.681 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:33 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:33.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:33.681 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:33 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:33.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:33.681 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:33 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:33.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:00:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:33 smithi040 bash[17964]: audit 2024-02-22T19:00:33.187820+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:00:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:33 smithi040 bash[17964]: audit 2024-02-22T19:00:33.189629+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:00:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:33 smithi040 bash[17964]: audit 2024-02-22T19:00:33.200850+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T19:00:33.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:33 smithi111 bash[14162]: audit 2024-02-22T19:00:33.187820+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:00:33.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:33 smithi111 bash[14162]: audit 2024-02-22T19:00:33.189629+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:00:33.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:33 smithi111 bash[14162]: audit 2024-02-22T19:00:33.200850+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T19:00:34.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:34 smithi040 bash[13988]: cluster 2024-02-22T19:00:32.907757+0000 mgr.y (mgr.24850) 48 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:34.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:34 smithi040 bash[13988]: cephadm 2024-02-22T19:00:33.191320+0000 mgr.y (mgr.24850) 49 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:00:34.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:34 smithi040 bash[13988]: cluster 2024-02-22T19:00:33.192509+0000 mgr.y (mgr.24850) 50 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 99 B/s rd, 0 op/s 2024-02-22T19:00:34.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:34 smithi040 bash[13988]: cluster 2024-02-22T19:00:33.193203+0000 mgr.y (mgr.24850) 51 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:34.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:34 smithi040 bash[17964]: cluster 2024-02-22T19:00:32.907757+0000 mgr.y (mgr.24850) 48 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:34.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:34 smithi040 bash[17964]: cephadm 2024-02-22T19:00:33.191320+0000 mgr.y (mgr.24850) 49 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:00:34.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:34 smithi040 bash[17964]: cluster 2024-02-22T19:00:33.192509+0000 mgr.y (mgr.24850) 50 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 99 B/s rd, 0 op/s 2024-02-22T19:00:34.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:34 smithi040 bash[17964]: cluster 2024-02-22T19:00:33.193203+0000 mgr.y (mgr.24850) 51 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:34.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:34 smithi111 bash[14162]: cluster 2024-02-22T19:00:32.907757+0000 mgr.y (mgr.24850) 48 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:00:34.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:34 smithi111 bash[14162]: cephadm 2024-02-22T19:00:33.191320+0000 mgr.y (mgr.24850) 49 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:00:34.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:34 smithi111 bash[14162]: cluster 2024-02-22T19:00:33.192509+0000 mgr.y (mgr.24850) 50 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 99 B/s rd, 0 op/s 2024-02-22T19:00:34.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:34 smithi111 bash[14162]: cluster 2024-02-22T19:00:33.193203+0000 mgr.y (mgr.24850) 51 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:34.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:34 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 5. 2024-02-22T19:00:34.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:34 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:00:34.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:34 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Start request repeated too quickly. 2024-02-22T19:00:34.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:34 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:00:34.716 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:00:34 smithi111 systemd[1]: Failed to start Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:00:36.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:36 smithi040 bash[13988]: cluster 2024-02-22T19:00:35.194746+0000 mgr.y (mgr.24850) 52 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:36.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:36 smithi040 bash[17964]: cluster 2024-02-22T19:00:35.194746+0000 mgr.y (mgr.24850) 52 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:36.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:36 smithi111 bash[14162]: cluster 2024-02-22T19:00:35.194746+0000 mgr.y (mgr.24850) 52 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:38.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:38 smithi040 bash[13988]: cluster 2024-02-22T19:00:37.195595+0000 mgr.y (mgr.24850) 53 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:38.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:38 smithi040 bash[17964]: cluster 2024-02-22T19:00:37.195595+0000 mgr.y (mgr.24850) 53 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:38.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:38 smithi111 bash[14162]: cluster 2024-02-22T19:00:37.195595+0000 mgr.y (mgr.24850) 53 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:40.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:40 smithi040 bash[13988]: cluster 2024-02-22T19:00:39.196394+0000 mgr.y (mgr.24850) 54 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:40.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:40 smithi040 bash[17964]: cluster 2024-02-22T19:00:39.196394+0000 mgr.y (mgr.24850) 54 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:40.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:40 smithi111 bash[14162]: cluster 2024-02-22T19:00:39.196394+0000 mgr.y (mgr.24850) 54 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:41.639Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:41.639Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:41.639Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:42 smithi040 bash[17964]: cluster 2024-02-22T19:00:41.197855+0000 mgr.y (mgr.24850) 55 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:42.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:42 smithi040 bash[13988]: cluster 2024-02-22T19:00:41.197855+0000 mgr.y (mgr.24850) 55 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:42.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:42 smithi111 bash[14162]: cluster 2024-02-22T19:00:41.197855+0000 mgr.y (mgr.24850) 55 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:43 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:43.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:43 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:43.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:43.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:43 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:43.526Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:00:44.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:44 smithi040 bash[13988]: cluster 2024-02-22T19:00:43.198725+0000 mgr.y (mgr.24850) 56 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:44.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:44 smithi040 bash[17964]: cluster 2024-02-22T19:00:43.198725+0000 mgr.y (mgr.24850) 56 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:44.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:44 smithi111 bash[14162]: cluster 2024-02-22T19:00:43.198725+0000 mgr.y (mgr.24850) 56 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:46.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:46 smithi040 bash[17964]: cluster 2024-02-22T19:00:45.200400+0000 mgr.y (mgr.24850) 57 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:46.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:46 smithi040 bash[13988]: cluster 2024-02-22T19:00:45.200400+0000 mgr.y (mgr.24850) 57 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:46.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:46 smithi111 bash[14162]: cluster 2024-02-22T19:00:45.200400+0000 mgr.y (mgr.24850) 57 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:48.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:48 smithi040 bash[13988]: cluster 2024-02-22T19:00:47.201285+0000 mgr.y (mgr.24850) 58 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:48.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:48 smithi040 bash[17964]: cluster 2024-02-22T19:00:47.201285+0000 mgr.y (mgr.24850) 58 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:48.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:48 smithi111 bash[14162]: cluster 2024-02-22T19:00:47.201285+0000 mgr.y (mgr.24850) 58 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:50.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:50 smithi040 bash[17964]: cluster 2024-02-22T19:00:49.202203+0000 mgr.y (mgr.24850) 59 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:50.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:50 smithi040 bash[13988]: cluster 2024-02-22T19:00:49.202203+0000 mgr.y (mgr.24850) 59 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:50.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:50 smithi111 bash[14162]: cluster 2024-02-22T19:00:49.202203+0000 mgr.y (mgr.24850) 59 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:51.639Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:00:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:51.639Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:00:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:00:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:00:51.639Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:00:52.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:52 smithi040 bash[13988]: cluster 2024-02-22T19:00:51.203767+0000 mgr.y (mgr.24850) 60 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:52.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:52 smithi040 bash[17964]: cluster 2024-02-22T19:00:51.203767+0000 mgr.y (mgr.24850) 60 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:52.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:52 smithi111 bash[14162]: cluster 2024-02-22T19:00:51.203767+0000 mgr.y (mgr.24850) 60 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:54.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:54 smithi040 bash[13988]: cluster 2024-02-22T19:00:53.204526+0000 mgr.y (mgr.24850) 61 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:54.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:54 smithi040 bash[17964]: cluster 2024-02-22T19:00:53.204526+0000 mgr.y (mgr.24850) 61 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:54.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:54 smithi111 bash[14162]: cluster 2024-02-22T19:00:53.204526+0000 mgr.y (mgr.24850) 61 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:56.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:56 smithi040 bash[13988]: cluster 2024-02-22T19:00:55.206037+0000 mgr.y (mgr.24850) 62 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:56 smithi040 bash[17964]: cluster 2024-02-22T19:00:55.206037+0000 mgr.y (mgr.24850) 62 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:56.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:56 smithi111 bash[14162]: cluster 2024-02-22T19:00:55.206037+0000 mgr.y (mgr.24850) 62 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:58.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:00:58 smithi040 bash[13988]: cluster 2024-02-22T19:00:57.206772+0000 mgr.y (mgr.24850) 63 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:58.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:00:58 smithi040 bash[17964]: cluster 2024-02-22T19:00:57.206772+0000 mgr.y (mgr.24850) 63 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:00:58.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:00:58 smithi111 bash[14162]: cluster 2024-02-22T19:00:57.206772+0000 mgr.y (mgr.24850) 63 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:00.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:00 smithi040 bash[13988]: cluster 2024-02-22T19:00:59.207510+0000 mgr.y (mgr.24850) 64 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:00.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:00 smithi040 bash[17964]: cluster 2024-02-22T19:00:59.207510+0000 mgr.y (mgr.24850) 64 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:00.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:00 smithi111 bash[14162]: cluster 2024-02-22T19:00:59.207510+0000 mgr.y (mgr.24850) 64 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:01.640Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:01:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:01.640Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:01:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:01.640Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:01:02.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:02 smithi040 bash[13988]: cluster 2024-02-22T19:01:01.209070+0000 mgr.y (mgr.24850) 65 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:02.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:02 smithi040 bash[17964]: cluster 2024-02-22T19:01:01.209070+0000 mgr.y (mgr.24850) 65 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:02.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:02 smithi111 bash[14162]: cluster 2024-02-22T19:01:01.209070+0000 mgr.y (mgr.24850) 65 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:04.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:04 smithi040 bash[13988]: cluster 2024-02-22T19:01:03.209798+0000 mgr.y (mgr.24850) 66 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:04.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:04 smithi040 bash[17964]: cluster 2024-02-22T19:01:03.209798+0000 mgr.y (mgr.24850) 66 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:04.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:04 smithi111 bash[14162]: cluster 2024-02-22T19:01:03.209798+0000 mgr.y (mgr.24850) 66 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:06.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:06 smithi040 bash[13988]: cluster 2024-02-22T19:01:05.211363+0000 mgr.y (mgr.24850) 67 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:06.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:06 smithi040 bash[17964]: cluster 2024-02-22T19:01:05.211363+0000 mgr.y (mgr.24850) 67 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:06.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:06 smithi111 bash[14162]: cluster 2024-02-22T19:01:05.211363+0000 mgr.y (mgr.24850) 67 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:08.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:08 smithi040 bash[13988]: cluster 2024-02-22T19:01:07.212091+0000 mgr.y (mgr.24850) 68 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:08.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:08 smithi040 bash[17964]: cluster 2024-02-22T19:01:07.212091+0000 mgr.y (mgr.24850) 68 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:08.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:08 smithi111 bash[14162]: cluster 2024-02-22T19:01:07.212091+0000 mgr.y (mgr.24850) 68 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:10.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:10 smithi040 bash[17964]: cluster 2024-02-22T19:01:09.212842+0000 mgr.y (mgr.24850) 69 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:10.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:10 smithi040 bash[13988]: cluster 2024-02-22T19:01:09.212842+0000 mgr.y (mgr.24850) 69 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:10.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:10 smithi111 bash[14162]: cluster 2024-02-22T19:01:09.212842+0000 mgr.y (mgr.24850) 69 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:11.640Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:01:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:11.640Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:01:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:11.640Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:01:12.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:12 smithi040 bash[13988]: cluster 2024-02-22T19:01:11.214388+0000 mgr.y (mgr.24850) 70 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:12.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:12 smithi040 bash[17964]: cluster 2024-02-22T19:01:11.214388+0000 mgr.y (mgr.24850) 70 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:12.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:12 smithi111 bash[14162]: cluster 2024-02-22T19:01:11.214388+0000 mgr.y (mgr.24850) 70 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:14.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[13988]: cluster 2024-02-22T19:01:13.215159+0000 mgr.y (mgr.24850) 71 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:14.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[13988]: audit 2024-02-22T19:01:14.194925+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[13988]: audit 2024-02-22T19:01:14.195733+0000 mon.c (mon.1) 116 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[13988]: audit 2024-02-22T19:01:14.195773+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[13988]: audit 2024-02-22T19:01:14.196482+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[13988]: audit 2024-02-22T19:01:14.197292+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[13988]: audit 2024-02-22T19:01:14.198530+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[17964]: cluster 2024-02-22T19:01:13.215159+0000 mgr.y (mgr.24850) 71 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[17964]: audit 2024-02-22T19:01:14.194925+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[17964]: audit 2024-02-22T19:01:14.195733+0000 mon.c (mon.1) 116 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[17964]: audit 2024-02-22T19:01:14.195773+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[17964]: audit 2024-02-22T19:01:14.196482+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[17964]: audit 2024-02-22T19:01:14.197292+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-22T19:01:14.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:14 smithi040 bash[17964]: audit 2024-02-22T19:01:14.198530+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:14 smithi111 bash[14162]: cluster 2024-02-22T19:01:13.215159+0000 mgr.y (mgr.24850) 71 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:14.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:14 smithi111 bash[14162]: audit 2024-02-22T19:01:14.194925+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:14 smithi111 bash[14162]: audit 2024-02-22T19:01:14.195733+0000 mon.c (mon.1) 116 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-22T19:01:14.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:14 smithi111 bash[14162]: audit 2024-02-22T19:01:14.195773+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:14 smithi111 bash[14162]: audit 2024-02-22T19:01:14.196482+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T19:01:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:14 smithi111 bash[14162]: audit 2024-02-22T19:01:14.197292+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-22T19:01:14.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:14 smithi111 bash[14162]: audit 2024-02-22T19:01:14.198530+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T19:01:16.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:16 smithi040 bash[13988]: cluster 2024-02-22T19:01:15.216632+0000 mgr.y (mgr.24850) 72 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:16.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:16 smithi040 bash[17964]: cluster 2024-02-22T19:01:15.216632+0000 mgr.y (mgr.24850) 72 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:16.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:16 smithi111 bash[14162]: cluster 2024-02-22T19:01:15.216632+0000 mgr.y (mgr.24850) 72 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:18.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:18 smithi040 bash[13988]: cluster 2024-02-22T19:01:17.217345+0000 mgr.y (mgr.24850) 73 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:18.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:18 smithi040 bash[17964]: cluster 2024-02-22T19:01:17.217345+0000 mgr.y (mgr.24850) 73 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:18.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:18 smithi111 bash[14162]: cluster 2024-02-22T19:01:17.217345+0000 mgr.y (mgr.24850) 73 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:20.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:20 smithi040 bash[13988]: cluster 2024-02-22T19:01:19.218066+0000 mgr.y (mgr.24850) 74 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:20.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:20 smithi040 bash[17964]: cluster 2024-02-22T19:01:19.218066+0000 mgr.y (mgr.24850) 74 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:20.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:20 smithi111 bash[14162]: cluster 2024-02-22T19:01:19.218066+0000 mgr.y (mgr.24850) 74 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:21.641Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:01:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:21.641Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:01:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:21.641Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:01:22.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:22 smithi040 bash[13988]: cluster 2024-02-22T19:01:21.219568+0000 mgr.y (mgr.24850) 75 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:22.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:22 smithi040 bash[17964]: cluster 2024-02-22T19:01:21.219568+0000 mgr.y (mgr.24850) 75 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:22.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:22 smithi111 bash[14162]: cluster 2024-02-22T19:01:21.219568+0000 mgr.y (mgr.24850) 75 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:24.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:24 smithi040 bash[13988]: cluster 2024-02-22T19:01:23.220353+0000 mgr.y (mgr.24850) 76 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:24.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:24 smithi040 bash[17964]: cluster 2024-02-22T19:01:23.220353+0000 mgr.y (mgr.24850) 76 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:24.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:24 smithi111 bash[14162]: cluster 2024-02-22T19:01:23.220353+0000 mgr.y (mgr.24850) 76 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:26.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:26 smithi040 bash[13988]: cluster 2024-02-22T19:01:25.221814+0000 mgr.y (mgr.24850) 77 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:26.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:26 smithi040 bash[17964]: cluster 2024-02-22T19:01:25.221814+0000 mgr.y (mgr.24850) 77 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:26.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:26 smithi111 bash[14162]: cluster 2024-02-22T19:01:25.221814+0000 mgr.y (mgr.24850) 77 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:28.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:28 smithi040 bash[13988]: cluster 2024-02-22T19:01:27.222550+0000 mgr.y (mgr.24850) 78 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:28.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:28 smithi040 bash[17964]: cluster 2024-02-22T19:01:27.222550+0000 mgr.y (mgr.24850) 78 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:28.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:28 smithi111 bash[14162]: cluster 2024-02-22T19:01:27.222550+0000 mgr.y (mgr.24850) 78 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:30.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:30 smithi040 bash[13988]: cluster 2024-02-22T19:01:29.223309+0000 mgr.y (mgr.24850) 79 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:30.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:30 smithi040 bash[17964]: cluster 2024-02-22T19:01:29.223309+0000 mgr.y (mgr.24850) 79 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:30.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:30 smithi111 bash[14162]: cluster 2024-02-22T19:01:29.223309+0000 mgr.y (mgr.24850) 79 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:31.641Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:01:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:31.641Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:01:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:31.641Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:01:32.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:32 smithi040 bash[13988]: cluster 2024-02-22T19:01:31.224827+0000 mgr.y (mgr.24850) 80 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:32.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:32 smithi040 bash[17964]: cluster 2024-02-22T19:01:31.224827+0000 mgr.y (mgr.24850) 80 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:32.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:32 smithi111 bash[14162]: cluster 2024-02-22T19:01:31.224827+0000 mgr.y (mgr.24850) 80 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[13988]: cluster 2024-02-22T19:01:33.225547+0000 mgr.y (mgr.24850) 81 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[13988]: audit 2024-02-22T19:01:33.503985+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:01:34.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[13988]: audit 2024-02-22T19:01:33.505862+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:01:34.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[13988]: cephadm 2024-02-22T19:01:33.507435+0000 mgr.y (mgr.24850) 82 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:01:34.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[13988]: cluster 2024-02-22T19:01:33.508626+0000 mgr.y (mgr.24850) 83 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[13988]: cluster 2024-02-22T19:01:33.509175+0000 mgr.y (mgr.24850) 84 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[13988]: audit 2024-02-22T19:01:33.518665+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T19:01:34.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[17964]: cluster 2024-02-22T19:01:33.225547+0000 mgr.y (mgr.24850) 81 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[17964]: audit 2024-02-22T19:01:33.503985+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:01:34.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[17964]: audit 2024-02-22T19:01:33.505862+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:01:34.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[17964]: cephadm 2024-02-22T19:01:33.507435+0000 mgr.y (mgr.24850) 82 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:01:34.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[17964]: cluster 2024-02-22T19:01:33.508626+0000 mgr.y (mgr.24850) 83 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[17964]: cluster 2024-02-22T19:01:33.509175+0000 mgr.y (mgr.24850) 84 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:34 smithi040 bash[17964]: audit 2024-02-22T19:01:33.518665+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T19:01:34.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:34 smithi111 bash[14162]: cluster 2024-02-22T19:01:33.225547+0000 mgr.y (mgr.24850) 81 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:34 smithi111 bash[14162]: audit 2024-02-22T19:01:33.503985+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:01:34.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:34 smithi111 bash[14162]: audit 2024-02-22T19:01:33.505862+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:01:34.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:34 smithi111 bash[14162]: cephadm 2024-02-22T19:01:33.507435+0000 mgr.y (mgr.24850) 82 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:01:34.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:34 smithi111 bash[14162]: cluster 2024-02-22T19:01:33.508626+0000 mgr.y (mgr.24850) 83 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:34 smithi111 bash[14162]: cluster 2024-02-22T19:01:33.509175+0000 mgr.y (mgr.24850) 84 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:34.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:34 smithi111 bash[14162]: audit 2024-02-22T19:01:33.518665+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.24850 ' entity='mgr.y' 2024-02-22T19:01:36.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:36 smithi040 bash[13988]: cluster 2024-02-22T19:01:35.510667+0000 mgr.y (mgr.24850) 85 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:36.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:36 smithi040 bash[17964]: cluster 2024-02-22T19:01:35.510667+0000 mgr.y (mgr.24850) 85 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:36.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:36 smithi111 bash[14162]: cluster 2024-02-22T19:01:35.510667+0000 mgr.y (mgr.24850) 85 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:38.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:38 smithi040 bash[13988]: cluster 2024-02-22T19:01:37.511351+0000 mgr.y (mgr.24850) 86 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:38.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:38 smithi040 bash[17964]: cluster 2024-02-22T19:01:37.511351+0000 mgr.y (mgr.24850) 86 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:38.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:38 smithi111 bash[14162]: cluster 2024-02-22T19:01:37.511351+0000 mgr.y (mgr.24850) 86 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:40.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:40 smithi040 bash[13988]: cluster 2024-02-22T19:01:39.512807+0000 mgr.y (mgr.24850) 87 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:40.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:40 smithi040 bash[17964]: cluster 2024-02-22T19:01:39.512807+0000 mgr.y (mgr.24850) 87 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:40.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:40 smithi111 bash[14162]: cluster 2024-02-22T19:01:39.512807+0000 mgr.y (mgr.24850) 87 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:41.641Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:01:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:41.641Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:01:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:41.641Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:01:42.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:42 smithi040 bash[13988]: cluster 2024-02-22T19:01:41.513512+0000 mgr.y (mgr.24850) 88 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:42.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:42 smithi040 bash[17964]: cluster 2024-02-22T19:01:41.513512+0000 mgr.y (mgr.24850) 88 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:42.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:42 smithi111 bash[14162]: cluster 2024-02-22T19:01:41.513512+0000 mgr.y (mgr.24850) 88 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:44.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:44 smithi040 bash[13988]: cluster 2024-02-22T19:01:43.514233+0000 mgr.y (mgr.24850) 89 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:44.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:44 smithi040 bash[17964]: cluster 2024-02-22T19:01:43.514233+0000 mgr.y (mgr.24850) 89 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:44.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:44 smithi111 bash[14162]: cluster 2024-02-22T19:01:43.514233+0000 mgr.y (mgr.24850) 89 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:46.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:46 smithi040 bash[13988]: cluster 2024-02-22T19:01:45.515772+0000 mgr.y (mgr.24850) 90 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:46.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:46 smithi040 bash[17964]: cluster 2024-02-22T19:01:45.515772+0000 mgr.y (mgr.24850) 90 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:46.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:46 smithi111 bash[14162]: cluster 2024-02-22T19:01:45.515772+0000 mgr.y (mgr.24850) 90 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:48.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:48 smithi040 bash[13988]: cluster 2024-02-22T19:01:47.516583+0000 mgr.y (mgr.24850) 91 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:48.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:48 smithi040 bash[17964]: cluster 2024-02-22T19:01:47.516583+0000 mgr.y (mgr.24850) 91 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:48.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:48 smithi111 bash[14162]: cluster 2024-02-22T19:01:47.516583+0000 mgr.y (mgr.24850) 91 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:50.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:50 smithi040 bash[13988]: cluster 2024-02-22T19:01:49.518015+0000 mgr.y (mgr.24850) 92 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:50.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:50 smithi040 bash[17964]: cluster 2024-02-22T19:01:49.518015+0000 mgr.y (mgr.24850) 92 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:50.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:50 smithi111 bash[14162]: cluster 2024-02-22T19:01:49.518015+0000 mgr.y (mgr.24850) 92 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:51.642Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:01:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:51.642Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:01:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:01:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:01:51.642Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:01:52.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:52 smithi040 bash[17964]: cluster 2024-02-22T19:01:51.518713+0000 mgr.y (mgr.24850) 93 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:52.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:52 smithi040 bash[13988]: cluster 2024-02-22T19:01:51.518713+0000 mgr.y (mgr.24850) 93 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:52.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:52 smithi111 bash[14162]: cluster 2024-02-22T19:01:51.518713+0000 mgr.y (mgr.24850) 93 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:54.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:54 smithi040 bash[13988]: cluster 2024-02-22T19:01:53.519429+0000 mgr.y (mgr.24850) 94 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:54.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:54 smithi040 bash[17964]: cluster 2024-02-22T19:01:53.519429+0000 mgr.y (mgr.24850) 94 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:54.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:54 smithi111 bash[14162]: cluster 2024-02-22T19:01:53.519429+0000 mgr.y (mgr.24850) 94 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:56.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:56 smithi040 bash[13988]: cluster 2024-02-22T19:01:55.521030+0000 mgr.y (mgr.24850) 95 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:56.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:56 smithi040 bash[17964]: cluster 2024-02-22T19:01:55.521030+0000 mgr.y (mgr.24850) 95 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:56.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:56 smithi111 bash[14162]: cluster 2024-02-22T19:01:55.521030+0000 mgr.y (mgr.24850) 95 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:58.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:01:58 smithi040 bash[13988]: cluster 2024-02-22T19:01:57.521818+0000 mgr.y (mgr.24850) 96 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:58.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:01:58 smithi040 bash[17964]: cluster 2024-02-22T19:01:57.521818+0000 mgr.y (mgr.24850) 96 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:01:58.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:01:58 smithi111 bash[14162]: cluster 2024-02-22T19:01:57.521818+0000 mgr.y (mgr.24850) 96 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:00.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:00 smithi040 bash[13988]: cluster 2024-02-22T19:01:59.523254+0000 mgr.y (mgr.24850) 97 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:00.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:00 smithi040 bash[17964]: cluster 2024-02-22T19:01:59.523254+0000 mgr.y (mgr.24850) 97 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:00.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:00 smithi111 bash[14162]: cluster 2024-02-22T19:01:59.523254+0000 mgr.y (mgr.24850) 97 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:01.642Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:02:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:01.642Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:02:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:01.642Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:02:02.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:02 smithi040 bash[13988]: cluster 2024-02-22T19:02:01.523986+0000 mgr.y (mgr.24850) 98 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:02.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:02 smithi040 bash[17964]: cluster 2024-02-22T19:02:01.523986+0000 mgr.y (mgr.24850) 98 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:02.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:02 smithi111 bash[14162]: cluster 2024-02-22T19:02:01.523986+0000 mgr.y (mgr.24850) 98 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:04.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:04 smithi040 bash[13988]: cluster 2024-02-22T19:02:03.524757+0000 mgr.y (mgr.24850) 99 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:04.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:04 smithi040 bash[17964]: cluster 2024-02-22T19:02:03.524757+0000 mgr.y (mgr.24850) 99 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:04.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:04 smithi111 bash[14162]: cluster 2024-02-22T19:02:03.524757+0000 mgr.y (mgr.24850) 99 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:06.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:06 smithi040 bash[13988]: cluster 2024-02-22T19:02:05.526344+0000 mgr.y (mgr.24850) 100 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:06.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:06 smithi040 bash[17964]: cluster 2024-02-22T19:02:05.526344+0000 mgr.y (mgr.24850) 100 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:06.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:06 smithi111 bash[14162]: cluster 2024-02-22T19:02:05.526344+0000 mgr.y (mgr.24850) 100 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:08.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:08 smithi040 bash[13988]: cluster 2024-02-22T19:02:07.527109+0000 mgr.y (mgr.24850) 101 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:08.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:08 smithi040 bash[17964]: cluster 2024-02-22T19:02:07.527109+0000 mgr.y (mgr.24850) 101 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:08.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:08 smithi111 bash[14162]: cluster 2024-02-22T19:02:07.527109+0000 mgr.y (mgr.24850) 101 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:10.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:10 smithi040 bash[13988]: cluster 2024-02-22T19:02:09.528548+0000 mgr.y (mgr.24850) 102 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:10.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:10 smithi040 bash[17964]: cluster 2024-02-22T19:02:09.528548+0000 mgr.y (mgr.24850) 102 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:10.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:10 smithi111 bash[14162]: cluster 2024-02-22T19:02:09.528548+0000 mgr.y (mgr.24850) 102 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:12.030 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:11.643Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:02:12.030 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:11.643Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:02:12.030 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:11.643Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:02:12.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ps' 2024-02-22T19:02:12.896 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:12 smithi040 bash[13988]: cluster 2024-02-22T19:02:11.529244+0000 mgr.y (mgr.24850) 103 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:12.896 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:12 smithi040 bash[17964]: cluster 2024-02-22T19:02:11.529244+0000 mgr.y (mgr.24850) 103 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:12.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:12 smithi111 bash[14162]: cluster 2024-02-22T19:02:11.529244+0000 mgr.y (mgr.24850) 103 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:14.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[13988]: cluster 2024-02-22T19:02:13.529966+0000 mgr.y (mgr.24850) 104 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[13988]: audit 2024-02-22T19:02:14.205126+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[13988]: audit 2024-02-22T19:02:14.205845+0000 mon.c (mon.1) 121 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[13988]: audit 2024-02-22T19:02:14.206284+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[13988]: audit 2024-02-22T19:02:14.206800+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[13988]: audit 2024-02-22T19:02:14.207919+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[13988]: audit 2024-02-22T19:02:14.209147+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[17964]: cluster 2024-02-22T19:02:13.529966+0000 mgr.y (mgr.24850) 104 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[17964]: audit 2024-02-22T19:02:14.205126+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[17964]: audit 2024-02-22T19:02:14.205845+0000 mon.c (mon.1) 121 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:02:14.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[17964]: audit 2024-02-22T19:02:14.206284+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[17964]: audit 2024-02-22T19:02:14.206800+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[17964]: audit 2024-02-22T19:02:14.207919+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:02:14.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:14 smithi040 bash[17964]: audit 2024-02-22T19:02:14.209147+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:14 smithi111 bash[14162]: cluster 2024-02-22T19:02:13.529966+0000 mgr.y (mgr.24850) 104 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:14.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:14 smithi111 bash[14162]: audit 2024-02-22T19:02:14.205126+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:14 smithi111 bash[14162]: audit 2024-02-22T19:02:14.205845+0000 mon.c (mon.1) 121 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:02:14.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:14 smithi111 bash[14162]: audit 2024-02-22T19:02:14.206284+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:14 smithi111 bash[14162]: audit 2024-02-22T19:02:14.206800+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:02:14.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:14 smithi111 bash[14162]: audit 2024-02-22T19:02:14.207919+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-22T19:02:14.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:14 smithi111 bash[14162]: audit 2024-02-22T19:02:14.209147+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:02:15.982 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (18m) 2m ago 18m 14.5M - 0.20.0 0881eb8f169f d07d332bcae5 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi111 running (18m) 2m ago 18m 27.5M - 6.6.2 a0dce381714a 5ee787fea36d 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi.iscsi.a smithi111 error 2m ago 19m - - 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi111 running (12m) 2m ago 23m 378M - 16.2.14-550-geb66ed92 7403d1862307 a875afad2b64 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (5m) 2m ago 25m 405M - 16.2.14-550-geb66ed92 7403d1862307 439ee1bc8662 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (25m) 2m ago 25m 76.2M 2048M 15.2.9 dfc483079636 3c89b7663858 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi111 running (23m) 2m ago 23m 57.5M 2048M 15.2.9 dfc483079636 336462e9a5d0 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (23m) 2m ago 23m 53.3M 2048M 15.2.9 dfc483079636 1f9be7bcd2e0 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (19m) 2m ago 19m 11.9M - 0.18.1 e5a616e4b9cf 3facd7c224ee 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi111 running (19m) 2m ago 19m 12.2M - 0.18.1 e5a616e4b9cf e0f6df3dcf29 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (22m) 2m ago 22m 46.4M 4096M 15.2.9 dfc483079636 6caadfc43004 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (22m) 2m ago 22m 47.5M 4096M 15.2.9 dfc483079636 c752ecdf2341 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (21m) 2m ago 21m 43.3M 4096M 15.2.9 dfc483079636 fa43ac3dae85 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (21m) 2m ago 21m 48.6M 4096M 15.2.9 dfc483079636 df5809aeb58e 2024-02-22T19:02:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi111 running (21m) 2m ago 21m 47.2M 4096M 15.2.9 dfc483079636 88b0bb37dbaf 2024-02-22T19:02:15.984 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi111 running (20m) 2m ago 20m 45.6M 4096M 15.2.9 dfc483079636 0e91fba2eb35 2024-02-22T19:02:15.984 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi111 running (20m) 2m ago 20m 44.8M 4096M 15.2.9 dfc483079636 7bc8f399b295 2024-02-22T19:02:15.984 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi111 running (19m) 2m ago 19m 46.8M 4096M 15.2.9 dfc483079636 59b477b24a62 2024-02-22T19:02:15.984 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi111 running (9m) 2m ago 19m 43.3M - 2.18.1 de242295e225 88a0cc7fd66c 2024-02-22T19:02:15.984 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.pyjfss smithi040 running (16m) 2m ago 16m 51.6M - 15.2.9 dfc483079636 47df35fb3739 2024-02-22T19:02:15.984 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi111.qafphs smithi111 running (16m) 2m ago 16m 51.3M - 15.2.9 dfc483079636 80fcb09b20c7 2024-02-22T19:02:16.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions' 2024-02-22T19:02:16.911 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: cluster 2024-02-22T19:02:15.531415+0000 mgr.y (mgr.24850) 105 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:16.911 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.954430+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.955366+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.956339+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.957353+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.958309+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.959070+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.962519+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.963215+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.963943+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.964654+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[17964]: audit 2024-02-22T19:02:15.965416+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.912 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: cluster 2024-02-22T19:02:15.531415+0000 mgr.y (mgr.24850) 105 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.954430+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.955366+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.956339+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.957353+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.958309+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.959070+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.962519+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.963215+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.963943+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.964654+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.913 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:16 smithi040 bash[13988]: audit 2024-02-22T19:02:15.965416+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: cluster 2024-02-22T19:02:15.531415+0000 mgr.y (mgr.24850) 105 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.954430+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:02:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.955366+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:02:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.956339+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.957353+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.958309+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.959070+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.962519+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:02:16.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.963215+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.963943+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.964654+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:16.967 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:16 smithi111 bash[14162]: audit 2024-02-22T19:02:15.965416+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:17.878 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:17 smithi040 bash[13988]: audit 2024-02-22T19:02:15.948212+0000 mgr.y (mgr.24850) 106 : audit [DBG] from='client.25009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:02:17.878 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:17 smithi040 bash[17964]: audit 2024-02-22T19:02:15.948212+0000 mgr.y (mgr.24850) 106 : audit [DBG] from='client.25009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:02:17.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:17 smithi111 bash[14162]: audit 2024-02-22T19:02:15.948212+0000 mgr.y (mgr.24850) 106 : audit [DBG] from='client.25009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:02:18.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:18 smithi040 bash[13988]: cluster 2024-02-22T19:02:17.532180+0000 mgr.y (mgr.24850) 107 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:18.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:18 smithi040 bash[17964]: cluster 2024-02-22T19:02:17.532180+0000 mgr.y (mgr.24850) 107 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:18.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:18 smithi111 bash[14162]: cluster 2024-02-22T19:02:17.532180+0000 mgr.y (mgr.24850) 107 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:20.009 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-22T19:02:20.009 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-22T19:02:20.009 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 3 2024-02-22T19:02:20.009 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T19:02:20.009 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-22T19:02:20.009 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T19:02:20.009 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T19:02:20.009 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 8 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 2 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 13, 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T19:02:20.010 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-22T19:02:20.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph -s' 2024-02-22T19:02:20.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:20 smithi040 bash[13988]: cluster 2024-02-22T19:02:19.533651+0000 mgr.y (mgr.24850) 108 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:20.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:20 smithi040 bash[13988]: audit 2024-02-22T19:02:20.004112+0000 mon.a (mon.0) 934 : audit [DBG] from='client.? 172.21.15.40:0/1999763553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:02:20.919 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:20 smithi040 bash[17964]: cluster 2024-02-22T19:02:19.533651+0000 mgr.y (mgr.24850) 108 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:20.919 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:20 smithi040 bash[17964]: audit 2024-02-22T19:02:20.004112+0000 mon.a (mon.0) 934 : audit [DBG] from='client.? 172.21.15.40:0/1999763553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:02:20.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:20 smithi111 bash[14162]: cluster 2024-02-22T19:02:19.533651+0000 mgr.y (mgr.24850) 108 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:20.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:20 smithi111 bash[14162]: audit 2024-02-22T19:02:20.004112+0000 mon.a (mon.0) 934 : audit [DBG] from='client.? 172.21.15.40:0/1999763553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:02:21.910 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:21.643Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:02:21.910 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:21.643Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:02:21.911 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:21.643Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:02:22.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:22 smithi040 bash[13988]: cluster 2024-02-22T19:02:21.534359+0000 mgr.y (mgr.24850) 109 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:22.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:22 smithi040 bash[17964]: cluster 2024-02-22T19:02:21.534359+0000 mgr.y (mgr.24850) 109 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:22.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:22 smithi111 bash[14162]: cluster 2024-02-22T19:02:21.534359+0000 mgr.y (mgr.24850) 109 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:23.974 INFO:teuthology.orchestra.run.smithi040.stdout: cluster: 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: id: 42039b9c-d1b1-11ee-95bf-87774f69a715 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: health: HEALTH_WARN 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: 1 failed cephadm daemon(s) 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: services: 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: mon: 3 daemons, quorum a,c,b (age 23m) 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: mgr: y(active, since 3m), standbys: x 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: osd: 8 osds: 8 up (since 19m), 8 in (since 19m) 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: rgw: 2 daemons active (r.z.smithi040.pyjfss, r.z.smithi111.qafphs) 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: task status: 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T19:02:23.975 INFO:teuthology.orchestra.run.smithi040.stdout: data: 2024-02-22T19:02:23.976 INFO:teuthology.orchestra.run.smithi040.stdout: pools: 6 pools, 132 pgs 2024-02-22T19:02:23.976 INFO:teuthology.orchestra.run.smithi040.stdout: objects: 202 objects, 7.4 KiB 2024-02-22T19:02:23.976 INFO:teuthology.orchestra.run.smithi040.stdout: usage: 8.0 GiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:23.976 INFO:teuthology.orchestra.run.smithi040.stdout: pgs: 132 active+clean 2024-02-22T19:02:23.976 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-22T19:02:24.667 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-22T19:02:24.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:24 smithi040 bash[13988]: cluster 2024-02-22T19:02:23.534982+0000 mgr.y (mgr.24850) 110 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:24.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:24 smithi040 bash[13988]: audit 2024-02-22T19:02:23.970359+0000 mon.c (mon.1) 134 : audit [DBG] from='client.? 172.21.15.40:0/2559980443' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T19:02:24.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:24 smithi040 bash[17964]: cluster 2024-02-22T19:02:23.534982+0000 mgr.y (mgr.24850) 110 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:24.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:24 smithi040 bash[17964]: audit 2024-02-22T19:02:23.970359+0000 mon.c (mon.1) 134 : audit [DBG] from='client.? 172.21.15.40:0/2559980443' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T19:02:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:24 smithi111 bash[14162]: cluster 2024-02-22T19:02:23.534982+0000 mgr.y (mgr.24850) 110 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:24 smithi111 bash[14162]: audit 2024-02-22T19:02:23.970359+0000 mon.c (mon.1) 134 : audit [DBG] from='client.? 172.21.15.40:0/2559980443' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T19:02:26.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:26 smithi040 bash[13988]: cluster 2024-02-22T19:02:25.536424+0000 mgr.y (mgr.24850) 111 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:26.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:26 smithi040 bash[17964]: cluster 2024-02-22T19:02:25.536424+0000 mgr.y (mgr.24850) 111 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:26.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:26 smithi111 bash[14162]: cluster 2024-02-22T19:02:25.536424+0000 mgr.y (mgr.24850) 111 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-22T19:02:28.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:28 smithi040 bash[13988]: cluster 2024-02-22T19:02:27.537099+0000 mgr.y (mgr.24850) 112 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:28.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:28 smithi040 bash[13988]: audit 2024-02-22T19:02:27.827396+0000 mon.a (mon.0) 935 : audit [DBG] from='client.? 172.21.15.40:0/3593982552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:02:28.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:28 smithi040 bash[17964]: cluster 2024-02-22T19:02:27.537099+0000 mgr.y (mgr.24850) 112 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:28.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:28 smithi040 bash[17964]: audit 2024-02-22T19:02:27.827396+0000 mon.a (mon.0) 935 : audit [DBG] from='client.? 172.21.15.40:0/3593982552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:02:28.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:28 smithi111 bash[14162]: cluster 2024-02-22T19:02:27.537099+0000 mgr.y (mgr.24850) 112 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:28.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:28 smithi111 bash[14162]: audit 2024-02-22T19:02:27.827396+0000 mon.a (mon.0) 935 : audit [DBG] from='client.? 172.21.15.40:0/3593982552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:02:28.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph mgr fail' 2024-02-22T19:02:30.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:30 smithi040 bash[13988]: cluster 2024-02-22T19:02:29.538594+0000 mgr.y (mgr.24850) 113 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:30.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:30 smithi040 bash[17964]: cluster 2024-02-22T19:02:29.538594+0000 mgr.y (mgr.24850) 113 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:30.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:30 smithi111 bash[14162]: cluster 2024-02-22T19:02:29.538594+0000 mgr.y (mgr.24850) 113 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:31.643Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:02:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:31.643Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:02:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:31.643Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:02:32.930 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[39752]: debug 2024-02-22T19:02:32.614+0000 7fecf0ad8700 -1 mgr handle_mgr_map I was active but no longer am 2024-02-22T19:02:32.930 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[39752]: ignoring --setuser ceph since I am not root 2024-02-22T19:02:32.930 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[39752]: ignoring --setgroup ceph since I am not root 2024-02-22T19:02:32.931 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[39752]: debug 2024-02-22T19:02:32.670+0000 7f801af99700 1 -- 172.21.15.40:0/2223986541 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564a17c404e0 con 0x564a17d34c00 2024-02-22T19:02:32.931 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[39752]: debug 2024-02-22T19:02:32.830+0000 7f802b176680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T19:02:32.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[13988]: cluster 2024-02-22T19:02:31.539276+0000 mgr.y (mgr.24850) 114 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:32.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[13988]: audit 2024-02-22T19:02:31.654332+0000 mon.a (mon.0) 936 : audit [INF] from='client.? 172.21.15.40:0/21712313' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T19:02:32.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[13988]: cluster 2024-02-22T19:02:31.661824+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-22T19:02:32.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[13988]: audit 2024-02-22T19:02:31.664279+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:02:32.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[13988]: audit 2024-02-22T19:02:31.672633+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:02:32.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[13988]: audit 2024-02-22T19:02:31.673731+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:02:32.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[13988]: audit 2024-02-22T19:02:31.674057+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:02:32.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[17964]: cluster 2024-02-22T19:02:31.539276+0000 mgr.y (mgr.24850) 114 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:32.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[17964]: audit 2024-02-22T19:02:31.654332+0000 mon.a (mon.0) 936 : audit [INF] from='client.? 172.21.15.40:0/21712313' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T19:02:32.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[17964]: cluster 2024-02-22T19:02:31.661824+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-22T19:02:32.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[17964]: audit 2024-02-22T19:02:31.664279+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:02:32.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[17964]: audit 2024-02-22T19:02:31.672633+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:02:32.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[17964]: audit 2024-02-22T19:02:31.673731+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:02:32.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[17964]: audit 2024-02-22T19:02:31.674057+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:02:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:32 smithi111 bash[14162]: cluster 2024-02-22T19:02:31.539276+0000 mgr.y (mgr.24850) 114 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 7.4 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:32 smithi111 bash[14162]: audit 2024-02-22T19:02:31.654332+0000 mon.a (mon.0) 936 : audit [INF] from='client.? 172.21.15.40:0/21712313' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-22T19:02:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:32 smithi111 bash[14162]: cluster 2024-02-22T19:02:31.661824+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-22T19:02:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:32 smithi111 bash[14162]: audit 2024-02-22T19:02:31.664279+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:02:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:32 smithi111 bash[14162]: audit 2024-02-22T19:02:31.672633+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:02:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:32 smithi111 bash[14162]: audit 2024-02-22T19:02:31.673731+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.24850 172.21.15.40:0/1286192989' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:02:32.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:32 smithi111 bash[14162]: audit 2024-02-22T19:02:31.674057+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:02:33.180 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:32 smithi040 bash[39752]: debug 2024-02-22T19:02:32.934+0000 7f802b176680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T19:02:33.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'sleep 180' 2024-02-22T19:02:33.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:33 smithi040 bash[39752]: debug 2024-02-22T19:02:33.394+0000 7f802b176680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T19:02:33.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:33 smithi040 bash[13988]: audit 2024-02-22T19:02:32.615431+0000 mon.a (mon.0) 940 : audit [INF] from='client.? 172.21.15.40:0/21712313' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-22T19:02:33.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:33 smithi040 bash[13988]: cluster 2024-02-22T19:02:32.615521+0000 mon.a (mon.0) 941 : cluster [DBG] mgrmap e26: x(active, starting, since 0.960309s) 2024-02-22T19:02:33.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:33 smithi040 bash[13988]: audit 2024-02-22T19:02:32.672437+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:02:33.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:33 smithi040 bash[13988]: cluster 2024-02-22T19:02:32.672564+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-22T19:02:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:33 smithi040 bash[17964]: audit 2024-02-22T19:02:32.615431+0000 mon.a (mon.0) 940 : audit [INF] from='client.? 172.21.15.40:0/21712313' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-22T19:02:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:33 smithi040 bash[17964]: cluster 2024-02-22T19:02:32.615521+0000 mon.a (mon.0) 941 : cluster [DBG] mgrmap e26: x(active, starting, since 0.960309s) 2024-02-22T19:02:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:33 smithi040 bash[17964]: audit 2024-02-22T19:02:32.672437+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:02:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:33 smithi040 bash[17964]: cluster 2024-02-22T19:02:32.672564+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-22T19:02:33.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:33 smithi111 bash[14162]: audit 2024-02-22T19:02:32.615431+0000 mon.a (mon.0) 940 : audit [INF] from='client.? 172.21.15.40:0/21712313' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-22T19:02:33.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:33 smithi111 bash[14162]: cluster 2024-02-22T19:02:32.615521+0000 mon.a (mon.0) 941 : cluster [DBG] mgrmap e26: x(active, starting, since 0.960309s) 2024-02-22T19:02:33.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:33 smithi111 bash[14162]: audit 2024-02-22T19:02:32.672437+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.24850 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:02:33.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:33 smithi111 bash[14162]: cluster 2024-02-22T19:02:32.672564+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-22T19:02:34.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:34 smithi040 bash[39752]: debug 2024-02-22T19:02:34.346+0000 7f802b176680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T19:02:34.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:34 smithi040 bash[39752]: debug 2024-02-22T19:02:34.442+0000 7f802b176680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T19:02:35.180 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:34 smithi040 bash[39752]: debug 2024-02-22T19:02:34.706+0000 7f802b176680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T19:02:36.150 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:35 smithi040 bash[39752]: debug 2024-02-22T19:02:35.870+0000 7f802b176680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T19:02:36.151 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:36 smithi040 bash[39752]: debug 2024-02-22T19:02:36.038+0000 7f802b176680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:02:36.430 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:36 smithi040 bash[39752]: debug 2024-02-22T19:02:36.142+0000 7f802b176680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T19:02:36.430 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:36 smithi040 bash[39752]: debug 2024-02-22T19:02:36.258+0000 7f802b176680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T19:02:36.879 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:36 smithi040 bash[39752]: debug 2024-02-22T19:02:36.490+0000 7f802b176680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T19:02:37.180 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:36 smithi040 bash[39752]: debug 2024-02-22T19:02:36.870+0000 7f802b176680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T19:02:37.180 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:37 smithi040 bash[39752]: debug 2024-02-22T19:02:36.998+0000 7f802b176680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T19:02:38.180 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:37 smithi040 bash[39752]: debug 2024-02-22T19:02:37.886+0000 7f802b176680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T19:02:38.180 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[39752]: debug 2024-02-22T19:02:37.998+0000 7f802b176680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T19:02:38.180 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[39752]: debug 2024-02-22T19:02:38.118+0000 7f802b176680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T19:02:38.654 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[39752]: debug 2024-02-22T19:02:38.346+0000 7f802b176680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.621907+0000 mon.a (mon.0) 944 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.622293+0000 mon.a (mon.0) 945 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.622637+0000 mon.a (mon.0) 946 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.624034+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.624618+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.625154+0000 mon.a (mon.0) 949 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.625645+0000 mon.a (mon.0) 950 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.626138+0000 mon.a (mon.0) 951 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.626625+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.627129+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.627665+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:02:38.922 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.628180+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:02:38.923 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.630387+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:02:38.923 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.630774+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:02:38.923 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.632073+0000 mon.a (mon.0) 958 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:02:38.923 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.633823+0000 mon.a (mon.0) 959 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:02:38.923 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.635670+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/client_keyrings"}]: dispatch 2024-02-22T19:02:38.923 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.636338+0000 mon.a (mon.0) 961 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:02:38.923 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[39752]: debug 2024-02-22T19:02:38.646+0000 7f802b176680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T19:02:38.923 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[39752]: debug 2024-02-22T19:02:38.822+0000 7f802b176680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.621907+0000 mon.a (mon.0) 944 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.622293+0000 mon.a (mon.0) 945 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.622637+0000 mon.a (mon.0) 946 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.624034+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.624618+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.625154+0000 mon.a (mon.0) 949 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.625645+0000 mon.a (mon.0) 950 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.626138+0000 mon.a (mon.0) 951 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.626625+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.627129+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.627665+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.628180+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.630387+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:02:38.924 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.630774+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:02:38.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.632073+0000 mon.a (mon.0) 958 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:02:38.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.633823+0000 mon.a (mon.0) 959 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:02:38.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.635670+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/client_keyrings"}]: dispatch 2024-02-22T19:02:38.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.636338+0000 mon.a (mon.0) 961 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:02:38.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.637222+0000 mon.a (mon.0) 962 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:02:38.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.638013+0000 mon.a (mon.0) 963 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:02:38.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.638779+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T19:02:38.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.639617+0000 mon.a (mon.0) 965 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T19:02:38.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.640574+0000 mon.a (mon.0) 966 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.641363+0000 mon.a (mon.0) 967 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.642266+0000 mon.a (mon.0) 968 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.643015+0000 mon.a (mon.0) 969 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.643841+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.644499+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.645258+0000 mon.a (mon.0) 972 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.645954+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.646698+0000 mon.a (mon.0) 974 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.647358+0000 mon.a (mon.0) 975 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.648132+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.648919+0000 mon.a (mon.0) 977 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.649673+0000 mon.a (mon.0) 978 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.650519+0000 mon.a (mon.0) 979 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:02:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.651339+0000 mon.a (mon.0) 980 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.652042+0000 mon.a (mon.0) 981 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.652901+0000 mon.a (mon.0) 982 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.653731+0000 mon.a (mon.0) 983 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.654517+0000 mon.a (mon.0) 984 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[17964]: audit 2024-02-22T19:02:38.655220+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.637222+0000 mon.a (mon.0) 962 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.638013+0000 mon.a (mon.0) 963 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.638779+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.639617+0000 mon.a (mon.0) 965 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T19:02:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.640574+0000 mon.a (mon.0) 966 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.641363+0000 mon.a (mon.0) 967 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.642266+0000 mon.a (mon.0) 968 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.643015+0000 mon.a (mon.0) 969 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.643841+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.644499+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.645258+0000 mon.a (mon.0) 972 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.645954+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.646698+0000 mon.a (mon.0) 974 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.647358+0000 mon.a (mon.0) 975 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.648132+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.648919+0000 mon.a (mon.0) 977 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.649673+0000 mon.a (mon.0) 978 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.650519+0000 mon.a (mon.0) 979 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:02:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.651339+0000 mon.a (mon.0) 980 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:02:38.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.652042+0000 mon.a (mon.0) 981 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:02:38.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.652901+0000 mon.a (mon.0) 982 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:02:38.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.653731+0000 mon.a (mon.0) 983 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:02:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.654517+0000 mon.a (mon.0) 984 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:02:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:38 smithi040 bash[13988]: audit 2024-02-22T19:02:38.655220+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:02:38.932 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[27054]: Warning: Permanently added '172.21.15.111' (ECDSA) to the list of known hosts. 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.621907+0000 mon.a (mon.0) 944 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.622293+0000 mon.a (mon.0) 945 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.622637+0000 mon.a (mon.0) 946 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.624034+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.624618+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.625154+0000 mon.a (mon.0) 949 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.625645+0000 mon.a (mon.0) 950 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.626138+0000 mon.a (mon.0) 951 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.626625+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.627129+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.627665+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:02:38.933 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.628180+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:02:38.934 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.630387+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:02:38.934 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.630774+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:02:38.934 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.632073+0000 mon.a (mon.0) 958 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:02:38.934 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.633823+0000 mon.a (mon.0) 959 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:02:38.934 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.635670+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/client_keyrings"}]: dispatch 2024-02-22T19:02:38.934 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.636338+0000 mon.a (mon.0) 961 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:02:38.934 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.637222+0000 mon.a (mon.0) 962 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:02:38.934 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.638013+0000 mon.a (mon.0) 963 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:02:38.934 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.638779+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.639617+0000 mon.a (mon.0) 965 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.640574+0000 mon.a (mon.0) 966 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.641363+0000 mon.a (mon.0) 967 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.642266+0000 mon.a (mon.0) 968 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.643015+0000 mon.a (mon.0) 969 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.643841+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.644499+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.645258+0000 mon.a (mon.0) 972 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.645954+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.646698+0000 mon.a (mon.0) 974 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.647358+0000 mon.a (mon.0) 975 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.648132+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.648919+0000 mon.a (mon.0) 977 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T19:02:38.935 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.649673+0000 mon.a (mon.0) 978 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T19:02:38.936 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.650519+0000 mon.a (mon.0) 979 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:02:38.936 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.651339+0000 mon.a (mon.0) 980 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:02:38.936 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.652042+0000 mon.a (mon.0) 981 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:02:38.936 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.652901+0000 mon.a (mon.0) 982 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:02:38.936 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.653731+0000 mon.a (mon.0) 983 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:02:38.936 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.654517+0000 mon.a (mon.0) 984 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:02:38.936 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[14162]: audit 2024-02-22T19:02:38.655220+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:02:39.180 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[39752]: debug 2024-02-22T19:02:39.014+0000 7f802b176680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:02:39.214 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:02:38 smithi111 bash[27054]: Warning: Permanently added '172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-22T19:02:39.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[39752]: debug 2024-02-22T19:02:39.254+0000 7f802b176680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T19:02:39.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[39752]: debug 2024-02-22T19:02:39.370+0000 7f802b176680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: cluster 2024-02-22T19:02:38.674917+0000 mon.a (mon.0) 986 : cluster [INF] Manager daemon x is now available 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: cluster 2024-02-22T19:02:38.733175+0000 mon.a (mon.0) 987 : cluster [DBG] mgrmap e27: x(active, since 7s) 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: cluster 2024-02-22T19:02:38.746183+0000 mgr.x (mgr.34862) 1 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: audit 2024-02-22T19:02:38.833301+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: audit 2024-02-22T19:02:38.913284+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: audit 2024-02-22T19:02:38.925696+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: audit 2024-02-22T19:02:39.165983+0000 mon.a (mon.0) 991 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: audit 2024-02-22T19:02:39.167001+0000 mon.a (mon.0) 992 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: cluster 2024-02-22T19:02:39.393750+0000 mon.a (mon.0) 993 : cluster [DBG] Standby manager daemon y started 2024-02-22T19:02:39.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: audit 2024-02-22T19:02:39.395997+0000 mon.a (mon.0) 994 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-22T19:02:39.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: audit 2024-02-22T19:02:39.396652+0000 mon.a (mon.0) 995 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:02:39.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: audit 2024-02-22T19:02:39.398372+0000 mon.a (mon.0) 996 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-22T19:02:39.966 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:39 smithi111 bash[14162]: audit 2024-02-22T19:02:39.398862+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:02:40.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: cluster 2024-02-22T19:02:38.674917+0000 mon.a (mon.0) 986 : cluster [INF] Manager daemon x is now available 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: cluster 2024-02-22T19:02:38.733175+0000 mon.a (mon.0) 987 : cluster [DBG] mgrmap e27: x(active, since 7s) 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: cluster 2024-02-22T19:02:38.746183+0000 mgr.x (mgr.34862) 1 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: audit 2024-02-22T19:02:38.833301+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: audit 2024-02-22T19:02:38.913284+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: audit 2024-02-22T19:02:38.925696+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: audit 2024-02-22T19:02:39.165983+0000 mon.a (mon.0) 991 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: audit 2024-02-22T19:02:39.167001+0000 mon.a (mon.0) 992 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: cluster 2024-02-22T19:02:39.393750+0000 mon.a (mon.0) 993 : cluster [DBG] Standby manager daemon y started 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: audit 2024-02-22T19:02:39.395997+0000 mon.a (mon.0) 994 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: audit 2024-02-22T19:02:39.396652+0000 mon.a (mon.0) 995 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: audit 2024-02-22T19:02:39.398372+0000 mon.a (mon.0) 996 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-22T19:02:40.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[13988]: audit 2024-02-22T19:02:39.398862+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: cluster 2024-02-22T19:02:38.674917+0000 mon.a (mon.0) 986 : cluster [INF] Manager daemon x is now available 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: cluster 2024-02-22T19:02:38.733175+0000 mon.a (mon.0) 987 : cluster [DBG] mgrmap e27: x(active, since 7s) 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: cluster 2024-02-22T19:02:38.746183+0000 mgr.x (mgr.34862) 1 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: audit 2024-02-22T19:02:38.833301+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: audit 2024-02-22T19:02:38.913284+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: audit 2024-02-22T19:02:38.925696+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: audit 2024-02-22T19:02:39.165983+0000 mon.a (mon.0) 991 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: audit 2024-02-22T19:02:39.167001+0000 mon.a (mon.0) 992 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: cluster 2024-02-22T19:02:39.393750+0000 mon.a (mon.0) 993 : cluster [DBG] Standby manager daemon y started 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: audit 2024-02-22T19:02:39.395997+0000 mon.a (mon.0) 994 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: audit 2024-02-22T19:02:39.396652+0000 mon.a (mon.0) 995 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: audit 2024-02-22T19:02:39.398372+0000 mon.a (mon.0) 996 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-22T19:02:40.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:39 smithi040 bash[17964]: audit 2024-02-22T19:02:39.398862+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.? 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:02:40.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:40 smithi111 bash[14162]: cluster 2024-02-22T19:02:39.729583+0000 mon.a (mon.0) 998 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-02-22T19:02:40.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:40 smithi111 bash[14162]: cluster 2024-02-22T19:02:39.729669+0000 mon.a (mon.0) 999 : cluster [INF] Cluster is now healthy 2024-02-22T19:02:40.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:40 smithi111 bash[14162]: cluster 2024-02-22T19:02:39.746691+0000 mon.a (mon.0) 1000 : cluster [DBG] mgrmap e28: x(active, since 8s), standbys: y 2024-02-22T19:02:40.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:40 smithi111 bash[14162]: audit 2024-02-22T19:02:39.748379+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:02:41.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:40 smithi040 bash[17964]: cluster 2024-02-22T19:02:39.729583+0000 mon.a (mon.0) 998 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-02-22T19:02:41.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:40 smithi040 bash[17964]: cluster 2024-02-22T19:02:39.729669+0000 mon.a (mon.0) 999 : cluster [INF] Cluster is now healthy 2024-02-22T19:02:41.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:40 smithi040 bash[17964]: cluster 2024-02-22T19:02:39.746691+0000 mon.a (mon.0) 1000 : cluster [DBG] mgrmap e28: x(active, since 8s), standbys: y 2024-02-22T19:02:41.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:40 smithi040 bash[17964]: audit 2024-02-22T19:02:39.748379+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:02:41.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:40 smithi040 bash[13988]: cluster 2024-02-22T19:02:39.729583+0000 mon.a (mon.0) 998 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-02-22T19:02:41.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:40 smithi040 bash[13988]: cluster 2024-02-22T19:02:39.729669+0000 mon.a (mon.0) 999 : cluster [INF] Cluster is now healthy 2024-02-22T19:02:41.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:40 smithi040 bash[13988]: cluster 2024-02-22T19:02:39.746691+0000 mon.a (mon.0) 1000 : cluster [DBG] mgrmap e28: x(active, since 8s), standbys: y 2024-02-22T19:02:41.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:40 smithi040 bash[13988]: audit 2024-02-22T19:02:39.748379+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:02:41.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:41 smithi040 bash[13988]: cluster 2024-02-22T19:02:40.632835+0000 mgr.x (mgr.34862) 2 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:41.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:41 smithi040 bash[13988]: cluster 2024-02-22T19:02:40.755843+0000 mon.a (mon.0) 1002 : cluster [DBG] mgrmap e29: x(active, since 9s), standbys: y 2024-02-22T19:02:41.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:41 smithi040 bash[17964]: cluster 2024-02-22T19:02:40.632835+0000 mgr.x (mgr.34862) 2 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:41.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:41 smithi040 bash[17964]: cluster 2024-02-22T19:02:40.755843+0000 mon.a (mon.0) 1002 : cluster [DBG] mgrmap e29: x(active, since 9s), standbys: y 2024-02-22T19:02:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:41.644Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T19:02:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:41.644Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T19:02:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:41.644Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused; Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused" 2024-02-22T19:02:42.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:41 smithi111 bash[14162]: cluster 2024-02-22T19:02:40.632835+0000 mgr.x (mgr.34862) 2 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:42.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:41 smithi111 bash[14162]: cluster 2024-02-22T19:02:40.755843+0000 mon.a (mon.0) 1002 : cluster [DBG] mgrmap e29: x(active, since 9s), standbys: y 2024-02-22T19:02:44.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:44 smithi040 bash[17964]: cluster 2024-02-22T19:02:42.633729+0000 mgr.x (mgr.34862) 3 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:44.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:44 smithi040 bash[13988]: cluster 2024-02-22T19:02:42.633729+0000 mgr.x (mgr.34862) 3 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:44.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:44 smithi111 bash[14162]: cluster 2024-02-22T19:02:42.633729+0000 mgr.x (mgr.34862) 3 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:46.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: cluster 2024-02-22T19:02:44.635013+0000 mgr.x (mgr.34862) 4 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:46.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.403563+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.655491+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.675781+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.676924+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.677972+0000 mon.a (mon.0) 1007 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.679081+0000 mon.a (mon.0) 1008 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.680048+0000 mon.a (mon.0) 1009 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.681211+0000 mon.a (mon.0) 1010 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.682342+0000 mon.a (mon.0) 1011 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.683415+0000 mon.a (mon.0) 1012 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.684379+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.921353+0000 mon.a (mon.0) 1014 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.922579+0000 mon.a (mon.0) 1015 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.466 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.923675+0000 mon.a (mon.0) 1016 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.924671+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.925838+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.926890+0000 mon.a (mon.0) 1019 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.927979+0000 mon.a (mon.0) 1020 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.929063+0000 mon.a (mon.0) 1021 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.930219+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.931617+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.933853+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.944522+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.953634+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.965146+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:46.467 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:46 smithi111 bash[14162]: audit 2024-02-22T19:02:45.967395+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T19:02:46.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: cluster 2024-02-22T19:02:44.635013+0000 mgr.x (mgr.34862) 4 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:46.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.403563+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:46.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.655491+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:46.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.675781+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.676924+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.677972+0000 mon.a (mon.0) 1007 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.679081+0000 mon.a (mon.0) 1008 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.680048+0000 mon.a (mon.0) 1009 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.681211+0000 mon.a (mon.0) 1010 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.682342+0000 mon.a (mon.0) 1011 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.683415+0000 mon.a (mon.0) 1012 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.684379+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.921353+0000 mon.a (mon.0) 1014 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.922579+0000 mon.a (mon.0) 1015 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.923675+0000 mon.a (mon.0) 1016 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.924671+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: cluster 2024-02-22T19:02:44.635013+0000 mgr.x (mgr.34862) 4 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:46.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.403563+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:46.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.655491+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:46.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.675781+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.676924+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.677972+0000 mon.a (mon.0) 1007 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.679081+0000 mon.a (mon.0) 1008 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.680048+0000 mon.a (mon.0) 1009 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.681211+0000 mon.a (mon.0) 1010 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.682342+0000 mon.a (mon.0) 1011 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.683415+0000 mon.a (mon.0) 1012 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.684379+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.921353+0000 mon.a (mon.0) 1014 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.922579+0000 mon.a (mon.0) 1015 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.923675+0000 mon.a (mon.0) 1016 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.924671+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.925838+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.926890+0000 mon.a (mon.0) 1019 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.927979+0000 mon.a (mon.0) 1020 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.929063+0000 mon.a (mon.0) 1021 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.930219+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.931617+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:46.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.933853+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:02:46.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.944522+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:46.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.953634+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:02:46.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.965146+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:46.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[17964]: audit 2024-02-22T19:02:45.967395+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T19:02:46.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.925838+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.926890+0000 mon.a (mon.0) 1019 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.927979+0000 mon.a (mon.0) 1020 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.929063+0000 mon.a (mon.0) 1021 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.930219+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.931617+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.933853+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.944522+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.953634+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.965146+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:46.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:46 smithi040 bash[13988]: audit 2024-02-22T19:02:45.967395+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T19:02:47.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:47 smithi111 bash[14162]: cephadm 2024-02-22T19:02:45.937957+0000 mgr.x (mgr.34862) 5 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:02:47.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:47 smithi111 bash[14162]: cluster 2024-02-22T19:02:45.939424+0000 mgr.x (mgr.34862) 6 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:47.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:47 smithi111 bash[14162]: cephadm 2024-02-22T19:02:45.955135+0000 mgr.x (mgr.34862) 7 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T19:02:47.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:47 smithi111 bash[14162]: cephadm 2024-02-22T19:02:45.968839+0000 mgr.x (mgr.34862) 8 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T19:02:47.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:47 smithi111 bash[14162]: cluster 2024-02-22T19:02:46.653068+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T19:02:47.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[13988]: cephadm 2024-02-22T19:02:45.937957+0000 mgr.x (mgr.34862) 5 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:02:47.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[13988]: cluster 2024-02-22T19:02:45.939424+0000 mgr.x (mgr.34862) 6 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:47.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[13988]: cephadm 2024-02-22T19:02:45.955135+0000 mgr.x (mgr.34862) 7 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T19:02:47.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[13988]: cephadm 2024-02-22T19:02:45.968839+0000 mgr.x (mgr.34862) 8 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T19:02:47.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[13988]: cluster 2024-02-22T19:02:46.653068+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T19:02:47.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[17964]: cephadm 2024-02-22T19:02:45.937957+0000 mgr.x (mgr.34862) 5 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:02:47.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[17964]: cluster 2024-02-22T19:02:45.939424+0000 mgr.x (mgr.34862) 6 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:47.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[17964]: cephadm 2024-02-22T19:02:45.955135+0000 mgr.x (mgr.34862) 7 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T19:02:47.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[17964]: cephadm 2024-02-22T19:02:45.968839+0000 mgr.x (mgr.34862) 8 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T19:02:47.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:47 smithi040 bash[17964]: cluster 2024-02-22T19:02:46.653068+0000 mon.a (mon.0) 1029 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T19:02:48.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:48 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:02:49.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:49 smithi111 bash[14162]: cluster 2024-02-22T19:02:47.940223+0000 mgr.x (mgr.34862) 9 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:49.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:49 smithi111 bash[14162]: audit 2024-02-22T19:02:48.283542+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:49.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:49 smithi111 bash[14162]: audit 2024-02-22T19:02:48.291879+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:02:49.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:49 smithi111 bash[14162]: audit 2024-02-22T19:02:48.299078+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:02:49.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:49 smithi111 bash[14162]: audit 2024-02-22T19:02:48.304287+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:02:49.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[17964]: cluster 2024-02-22T19:02:47.940223+0000 mgr.x (mgr.34862) 9 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:49.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[17964]: audit 2024-02-22T19:02:48.283542+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:49.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[17964]: audit 2024-02-22T19:02:48.291879+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:02:49.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[17964]: audit 2024-02-22T19:02:48.299078+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:02:49.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[17964]: audit 2024-02-22T19:02:48.304287+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:02:49.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[13988]: cluster 2024-02-22T19:02:47.940223+0000 mgr.x (mgr.34862) 9 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:49.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[13988]: audit 2024-02-22T19:02:48.283542+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:49.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[13988]: audit 2024-02-22T19:02:48.291879+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:02:49.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[13988]: audit 2024-02-22T19:02:48.299078+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:02:49.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:49 smithi040 bash[13988]: audit 2024-02-22T19:02:48.304287+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:02:49.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:49 smithi111 bash[34807]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T19:02:50.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[14162]: audit 2024-02-22T19:02:48.295162+0000 mgr.x (mgr.34862) 10 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:02:50.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[14162]: audit 2024-02-22T19:02:48.301980+0000 mgr.x (mgr.34862) 11 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:02:50.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:50 smithi040 bash[17964]: audit 2024-02-22T19:02:48.295162+0000 mgr.x (mgr.34862) 10 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:02:50.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:50 smithi040 bash[17964]: audit 2024-02-22T19:02:48.301980+0000 mgr.x (mgr.34862) 11 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:02:50.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:50 smithi040 bash[13988]: audit 2024-02-22T19:02:48.295162+0000 mgr.x (mgr.34862) 10 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:02:50.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:50 smithi040 bash[13988]: audit 2024-02-22T19:02:48.301980+0000 mgr.x (mgr.34862) 11 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:02:50.965 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: --- Logging error --- 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.send(msg) 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: During handling of the above exception, another exception occurred: 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.connect(address) 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: During handling of the above exception, another exception occurred: 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self._connect_unixsocket(self.address) 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:02:50.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.connect(address) 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Call stack: 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self._bootstrap_inner() 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.run() 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: logger.info("Started the configuration object watcher") 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Message: 'Started the configuration object watcher' 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Arguments: () 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: --- Logging error --- 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.send(msg) 2024-02-22T19:02:50.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: During handling of the above exception, another exception occurred: 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.connect(address) 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: During handling of the above exception, another exception occurred: 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self._connect_unixsocket(self.address) 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:02:50.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.connect(address) 2024-02-22T19:02:50.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:02:50.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Call stack: 2024-02-22T19:02:50.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:02:50.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: main() 2024-02-22T19:02:50.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:02:50.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:02:50.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T19:02:50.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T19:02:50.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T19:02:50.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Arguments: () 2024-02-22T19:02:50.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: --- Logging error --- 2024-02-22T19:02:50.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:02:50.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.send(msg) 2024-02-22T19:02:50.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:02:50.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: During handling of the above exception, another exception occurred: 2024-02-22T19:02:50.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:02:50.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.connect(address) 2024-02-22T19:02:50.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:02:50.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: During handling of the above exception, another exception occurred: 2024-02-22T19:02:50.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:02:50.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self._connect_unixsocket(self.address) 2024-02-22T19:02:50.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:02:50.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.connect(address) 2024-02-22T19:02:50.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:02:50.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Call stack: 2024-02-22T19:02:50.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:02:50.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self._bootstrap_inner() 2024-02-22T19:02:50.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:02:50.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.run() 2024-02-22T19:02:50.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T19:02:50.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.interval)) 2024-02-22T19:02:50.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Message: 'Checking for config object changes every 1s' 2024-02-22T19:02:50.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Arguments: () 2024-02-22T19:02:50.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: --- Logging error --- 2024-02-22T19:02:50.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:02:50.975 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.send(msg) 2024-02-22T19:02:50.975 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:02:50.975 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: During handling of the above exception, another exception occurred: 2024-02-22T19:02:50.975 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.975 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:02:50.975 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.connect(address) 2024-02-22T19:02:50.975 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:02:50.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: During handling of the above exception, another exception occurred: 2024-02-22T19:02:50.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:02:50.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self._connect_unixsocket(self.address) 2024-02-22T19:02:50.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:02:50.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: self.socket.connect(address) 2024-02-22T19:02:50.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:02:50.977 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Call stack: 2024-02-22T19:02:50.977 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:02:50.977 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: main() 2024-02-22T19:02:50.977 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:02:50.977 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:02:50.977 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:02:50.977 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:02:50.977 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T19:02:50.978 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: "{}".format(blacklisted_ip)) 2024-02-22T19:02:50.978 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/3116463761' 2024-02-22T19:02:50.978 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Arguments: () 2024-02-22T19:02:50.978 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: Traceback (most recent call last): 2024-02-22T19:02:50.978 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:02:50.978 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: main() 2024-02-22T19:02:50.978 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:02:50.978 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:02:50.979 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:02:50.979 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:02:50.979 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T19:02:50.979 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T19:02:50.979 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T19:02:50.979 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: **kwargs).stdout 2024-02-22T19:02:50.979 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T19:02:50.979 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: output=stdout, stderr=stderr) 2024-02-22T19:02:50.979 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:50 smithi111 bash[34821]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/3116463761' returned non-zero exit status 13. 2024-02-22T19:02:51.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:51 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:02:51.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:51 smithi111 bash[14162]: cluster 2024-02-22T19:02:49.942041+0000 mgr.x (mgr.34862) 12 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:51.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:51 smithi111 bash[14162]: audit 2024-02-22T19:02:50.277560+0000 mon.b (mon.2) 47 : audit [DBG] from='client.? 172.21.15.111:0/1914983682' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:02:51.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:51 smithi111 bash[14162]: audit 2024-02-22T19:02:50.611278+0000 mon.b (mon.2) 48 : audit [INF] from='client.? 172.21.15.111:0/3892616485' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:02:51.649 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:51 smithi040 bash[13988]: cluster 2024-02-22T19:02:49.942041+0000 mgr.x (mgr.34862) 12 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:51.649 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:51 smithi040 bash[13988]: audit 2024-02-22T19:02:50.277560+0000 mon.b (mon.2) 47 : audit [DBG] from='client.? 172.21.15.111:0/1914983682' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:02:51.649 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:51 smithi040 bash[13988]: audit 2024-02-22T19:02:50.611278+0000 mon.b (mon.2) 48 : audit [INF] from='client.? 172.21.15.111:0/3892616485' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:02:51.649 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:51 smithi040 bash[17964]: cluster 2024-02-22T19:02:49.942041+0000 mgr.x (mgr.34862) 12 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:51.650 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:51 smithi040 bash[17964]: audit 2024-02-22T19:02:50.277560+0000 mon.b (mon.2) 47 : audit [DBG] from='client.? 172.21.15.111:0/1914983682' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:02:51.650 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:51 smithi040 bash[17964]: audit 2024-02-22T19:02:50.611278+0000 mon.b (mon.2) 48 : audit [INF] from='client.? 172.21.15.111:0/3892616485' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:02:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:51.644Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:02:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:51.644Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:02:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:02:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:02:51.644Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:02:51.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:51 smithi111 bash[34807]: (process:1): GLib-GObject-CRITICAL **: 19:02:51.505: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T19:02:52.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:52 smithi111 bash[35063]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T19:02:52.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:02:52 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:02:53.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:53 smithi040 bash[13988]: cluster 2024-02-22T19:02:51.942957+0000 mgr.x (mgr.34862) 13 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:53.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:53 smithi040 bash[17964]: cluster 2024-02-22T19:02:51.942957+0000 mgr.x (mgr.34862) 13 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:53.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:53 smithi111 bash[14162]: cluster 2024-02-22T19:02:51.942957+0000 mgr.x (mgr.34862) 13 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:02:54.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:54 smithi040 bash[13988]: cluster 2024-02-22T19:02:53.944460+0000 mgr.x (mgr.34862) 14 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 90 B/s rd, 0 op/s 2024-02-22T19:02:54.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:54 smithi040 bash[17964]: cluster 2024-02-22T19:02:53.944460+0000 mgr.x (mgr.34862) 14 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 90 B/s rd, 0 op/s 2024-02-22T19:02:54.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:54 smithi111 bash[14162]: cluster 2024-02-22T19:02:53.944460+0000 mgr.x (mgr.34862) 14 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 90 B/s rd, 0 op/s 2024-02-22T19:02:57.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[17964]: cluster 2024-02-22T19:02:55.945216+0000 mgr.x (mgr.34862) 15 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 90 B/s rd, 0 op/s 2024-02-22T19:02:57.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[17964]: audit 2024-02-22T19:02:56.473321+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:57.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[17964]: audit 2024-02-22T19:02:56.475275+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:57.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[17964]: audit 2024-02-22T19:02:56.477317+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:02:57.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[17964]: audit 2024-02-22T19:02:56.489090+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:57.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[13988]: cluster 2024-02-22T19:02:55.945216+0000 mgr.x (mgr.34862) 15 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 90 B/s rd, 0 op/s 2024-02-22T19:02:57.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[13988]: audit 2024-02-22T19:02:56.473321+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:57.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[13988]: audit 2024-02-22T19:02:56.475275+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:57.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[13988]: audit 2024-02-22T19:02:56.477317+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:02:57.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:57 smithi040 bash[13988]: audit 2024-02-22T19:02:56.489090+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:57.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:57 smithi111 bash[14162]: cluster 2024-02-22T19:02:55.945216+0000 mgr.x (mgr.34862) 15 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 90 B/s rd, 0 op/s 2024-02-22T19:02:57.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:57 smithi111 bash[14162]: audit 2024-02-22T19:02:56.473321+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:57.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:57 smithi111 bash[14162]: audit 2024-02-22T19:02:56.475275+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:57.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:57 smithi111 bash[14162]: audit 2024-02-22T19:02:56.477317+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:02:57.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:57 smithi111 bash[14162]: audit 2024-02-22T19:02:56.489090+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:02:58.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:58 smithi040 bash[13988]: cephadm 2024-02-22T19:02:56.481554+0000 mgr.x (mgr.34862) 16 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:02:58.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:58 smithi040 bash[13988]: cluster 2024-02-22T19:02:56.482745+0000 mgr.x (mgr.34862) 17 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 97 B/s rd, 0 op/s 2024-02-22T19:02:58.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:02:58 smithi040 bash[13988]: cluster 2024-02-22T19:02:56.483301+0000 mgr.x (mgr.34862) 18 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 119 B/s rd, 0 op/s 2024-02-22T19:02:58.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:58 smithi040 bash[17964]: cephadm 2024-02-22T19:02:56.481554+0000 mgr.x (mgr.34862) 16 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:02:58.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:58 smithi040 bash[17964]: cluster 2024-02-22T19:02:56.482745+0000 mgr.x (mgr.34862) 17 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 97 B/s rd, 0 op/s 2024-02-22T19:02:58.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:02:58 smithi040 bash[17964]: cluster 2024-02-22T19:02:56.483301+0000 mgr.x (mgr.34862) 18 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 119 B/s rd, 0 op/s 2024-02-22T19:02:58.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:58 smithi111 bash[14162]: cephadm 2024-02-22T19:02:56.481554+0000 mgr.x (mgr.34862) 16 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:02:58.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:58 smithi111 bash[14162]: cluster 2024-02-22T19:02:56.482745+0000 mgr.x (mgr.34862) 17 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 97 B/s rd, 0 op/s 2024-02-22T19:02:58.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:02:58 smithi111 bash[14162]: cluster 2024-02-22T19:02:56.483301+0000 mgr.x (mgr.34862) 18 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 119 B/s rd, 0 op/s 2024-02-22T19:03:00.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:00 smithi111 bash[14162]: cluster 2024-02-22T19:02:58.484026+0000 mgr.x (mgr.34862) 19 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 119 B/s rd, 0 op/s 2024-02-22T19:03:00.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:00 smithi040 bash[13988]: cluster 2024-02-22T19:02:58.484026+0000 mgr.x (mgr.34862) 19 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 119 B/s rd, 0 op/s 2024-02-22T19:03:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:00 smithi040 bash[17964]: cluster 2024-02-22T19:02:58.484026+0000 mgr.x (mgr.34862) 19 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 119 B/s rd, 0 op/s 2024-02-22T19:03:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:01.644Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:03:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:01.644Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:03:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:01.645Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:03:02.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:02 smithi111 bash[14162]: cluster 2024-02-22T19:03:00.485546+0000 mgr.x (mgr.34862) 20 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 119 B/s rd, 0 op/s 2024-02-22T19:03:02.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:02 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 1. 2024-02-22T19:03:02.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:02 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:03:02.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:02 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:03:02.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:02 smithi040 bash[13988]: cluster 2024-02-22T19:03:00.485546+0000 mgr.x (mgr.34862) 20 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 119 B/s rd, 0 op/s 2024-02-22T19:03:02.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:02 smithi040 bash[17964]: cluster 2024-02-22T19:03:00.485546+0000 mgr.x (mgr.34862) 20 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 119 B/s rd, 0 op/s 2024-02-22T19:03:03.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:03 smithi111 bash[35688]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T19:03:04.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[14162]: cluster 2024-02-22T19:03:02.486312+0000 mgr.x (mgr.34862) 21 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:04.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:04 smithi040 bash[13988]: cluster 2024-02-22T19:03:02.486312+0000 mgr.x (mgr.34862) 21 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:04.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:04 smithi040 bash[17964]: cluster 2024-02-22T19:03:02.486312+0000 mgr.x (mgr.34862) 21 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:04.856 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: --- Logging error --- 2024-02-22T19:03:04.856 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.856 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:04.856 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.send(msg) 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.connect(address) 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self._connect_unixsocket(self.address) 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.connect(address) 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Call stack: 2024-02-22T19:03:04.857 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self._bootstrap_inner() 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.run() 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: logger.info("Started the configuration object watcher") 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Message: 'Started the configuration object watcher' 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Arguments: () 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: --- Logging error --- 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.send(msg) 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.858 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.connect(address) 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self._connect_unixsocket(self.address) 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.connect(address) 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Call stack: 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: main() 2024-02-22T19:03:04.859 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:04.860 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:04.860 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T19:03:04.860 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T19:03:04.860 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T19:03:04.860 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Arguments: () 2024-02-22T19:03:04.860 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: --- Logging error --- 2024-02-22T19:03:04.860 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.860 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:04.860 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.send(msg) 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.connect(address) 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self._connect_unixsocket(self.address) 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.connect(address) 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:04.861 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Call stack: 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self._bootstrap_inner() 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.run() 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.interval)) 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Message: 'Checking for config object changes every 1s' 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Arguments: () 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: --- Logging error --- 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.send(msg) 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.862 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.connect(address) 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self._connect_unixsocket(self.address) 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: self.socket.connect(address) 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Call stack: 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: main() 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:04.863 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:03:04.864 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:03:04.864 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T19:03:04.867 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: "{}".format(blacklisted_ip)) 2024-02-22T19:03:04.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/3116463761' 2024-02-22T19:03:04.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Arguments: () 2024-02-22T19:03:04.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: Traceback (most recent call last): 2024-02-22T19:03:04.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:04.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: main() 2024-02-22T19:03:04.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:04.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:04.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:03:04.868 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:03:04.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T19:03:04.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T19:03:04.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T19:03:04.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: **kwargs).stdout 2024-02-22T19:03:04.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T19:03:04.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: output=stdout, stderr=stderr) 2024-02-22T19:03:04.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:04 smithi111 bash[35704]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/3116463761' returned non-zero exit status 13. 2024-02-22T19:03:05.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:05 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:03:05.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:05 smithi111 bash[35688]: (process:1): GLib-GObject-CRITICAL **: 19:03:05.449: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T19:03:05.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:05 smithi111 bash[14162]: audit 2024-02-22T19:03:04.222746+0000 mon.b (mon.2) 49 : audit [DBG] from='client.? 172.21.15.111:0/2803819480' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:05.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:05 smithi111 bash[14162]: audit 2024-02-22T19:03:04.553437+0000 mon.b (mon.2) 50 : audit [INF] from='client.? 172.21.15.111:0/2224593333' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:05 smithi040 bash[13988]: audit 2024-02-22T19:03:04.222746+0000 mon.b (mon.2) 49 : audit [DBG] from='client.? 172.21.15.111:0/2803819480' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:05 smithi040 bash[13988]: audit 2024-02-22T19:03:04.553437+0000 mon.b (mon.2) 50 : audit [INF] from='client.? 172.21.15.111:0/2224593333' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:05.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:05 smithi040 bash[17964]: audit 2024-02-22T19:03:04.222746+0000 mon.b (mon.2) 49 : audit [DBG] from='client.? 172.21.15.111:0/2803819480' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:05.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:05 smithi040 bash[17964]: audit 2024-02-22T19:03:04.553437+0000 mon.b (mon.2) 50 : audit [INF] from='client.? 172.21.15.111:0/2224593333' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:06.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:06 smithi111 bash[14162]: cluster 2024-02-22T19:03:04.487776+0000 mgr.x (mgr.34862) 22 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:06.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:05 smithi111 bash[35915]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T19:03:06.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:05 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:03:06.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:06 smithi040 bash[13988]: cluster 2024-02-22T19:03:04.487776+0000 mgr.x (mgr.34862) 22 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:06.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:06 smithi040 bash[17964]: cluster 2024-02-22T19:03:04.487776+0000 mgr.x (mgr.34862) 22 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:08.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:08 smithi040 bash[13988]: cluster 2024-02-22T19:03:06.488514+0000 mgr.x (mgr.34862) 23 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:08 smithi040 bash[17964]: cluster 2024-02-22T19:03:06.488514+0000 mgr.x (mgr.34862) 23 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:08.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:08 smithi111 bash[14162]: cluster 2024-02-22T19:03:06.488514+0000 mgr.x (mgr.34862) 23 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:10.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:10 smithi040 bash[13988]: cluster 2024-02-22T19:03:08.489257+0000 mgr.x (mgr.34862) 24 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:10.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:10 smithi040 bash[17964]: cluster 2024-02-22T19:03:08.489257+0000 mgr.x (mgr.34862) 24 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:10.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:10 smithi111 bash[14162]: cluster 2024-02-22T19:03:08.489257+0000 mgr.x (mgr.34862) 24 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:11.650 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:11 smithi040 bash[13988]: cluster 2024-02-22T19:03:10.490800+0000 mgr.x (mgr.34862) 25 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:11.650 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:11 smithi040 bash[17964]: cluster 2024-02-22T19:03:10.490800+0000 mgr.x (mgr.34862) 25 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:11.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:11 smithi111 bash[14162]: cluster 2024-02-22T19:03:10.490800+0000 mgr.x (mgr.34862) 25 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:11.645Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:03:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:11.645Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:03:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:11.645Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:03:14.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:14 smithi111 bash[14162]: cluster 2024-02-22T19:03:12.491637+0000 mgr.x (mgr.34862) 26 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:14.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:14 smithi040 bash[13988]: cluster 2024-02-22T19:03:12.491637+0000 mgr.x (mgr.34862) 26 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:14.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:14 smithi040 bash[17964]: cluster 2024-02-22T19:03:12.491637+0000 mgr.x (mgr.34862) 26 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:16.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:16 smithi111 bash[14162]: cluster 2024-02-22T19:03:14.493288+0000 mgr.x (mgr.34862) 27 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:16.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:16 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 2. 2024-02-22T19:03:16.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:16 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:03:16.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:16 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:03:16.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:16 smithi040 bash[13988]: cluster 2024-02-22T19:03:14.493288+0000 mgr.x (mgr.34862) 27 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:16.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:16 smithi040 bash[17964]: cluster 2024-02-22T19:03:14.493288+0000 mgr.x (mgr.34862) 27 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:17.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:17 smithi111 bash[35973]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T19:03:18.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[14162]: cluster 2024-02-22T19:03:16.494175+0000 mgr.x (mgr.34862) 28 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:18 smithi040 bash[13988]: cluster 2024-02-22T19:03:16.494175+0000 mgr.x (mgr.34862) 28 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:18.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:18 smithi040 bash[17964]: cluster 2024-02-22T19:03:16.494175+0000 mgr.x (mgr.34862) 28 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:18.965 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: --- Logging error --- 2024-02-22T19:03:18.965 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.send(msg) 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.connect(address) 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self._connect_unixsocket(self.address) 2024-02-22T19:03:18.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.connect(address) 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Call stack: 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self._bootstrap_inner() 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.run() 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: logger.info("Started the configuration object watcher") 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Message: 'Started the configuration object watcher' 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Arguments: () 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: --- Logging error --- 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:18.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.send(msg) 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.connect(address) 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self._connect_unixsocket(self.address) 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.connect(address) 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:18.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Call stack: 2024-02-22T19:03:18.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:18.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: main() 2024-02-22T19:03:18.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:18.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:18.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T19:03:18.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T19:03:18.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T19:03:18.969 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Arguments: () 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: --- Logging error --- 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.send(msg) 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.connect(address) 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self._connect_unixsocket(self.address) 2024-02-22T19:03:18.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.connect(address) 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Call stack: 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self._bootstrap_inner() 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.run() 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.interval)) 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Message: 'Checking for config object changes every 1s' 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Arguments: () 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: --- Logging error --- 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.send(msg) 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:18.971 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.connect(address) 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self._connect_unixsocket(self.address) 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: self.socket.connect(address) 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Call stack: 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:18.972 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: main() 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: "{}".format(blacklisted_ip)) 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/3116463761' 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Arguments: () 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: Traceback (most recent call last): 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: main() 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:03:18.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T19:03:18.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T19:03:18.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T19:03:18.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: **kwargs).stdout 2024-02-22T19:03:18.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T19:03:18.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: output=stdout, stderr=stderr) 2024-02-22T19:03:18.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:18 smithi111 bash[35989]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/3116463761' returned non-zero exit status 13. 2024-02-22T19:03:19.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:19 smithi111 bash[14162]: audit 2024-02-22T19:03:18.235463+0000 mon.b (mon.2) 51 : audit [DBG] from='client.? 172.21.15.111:0/1190330541' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:19.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:19 smithi111 bash[14162]: audit 2024-02-22T19:03:18.567102+0000 mon.b (mon.2) 52 : audit [INF] from='client.? 172.21.15.111:0/3301025105' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:19.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:19 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:03:19.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:19 smithi111 bash[35973]: (process:1): GLib-GObject-CRITICAL **: 19:03:19.405: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T19:03:19.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:19 smithi040 bash[13988]: audit 2024-02-22T19:03:18.235463+0000 mon.b (mon.2) 51 : audit [DBG] from='client.? 172.21.15.111:0/1190330541' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:19.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:19 smithi040 bash[13988]: audit 2024-02-22T19:03:18.567102+0000 mon.b (mon.2) 52 : audit [INF] from='client.? 172.21.15.111:0/3301025105' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:19.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:19 smithi040 bash[17964]: audit 2024-02-22T19:03:18.235463+0000 mon.b (mon.2) 51 : audit [DBG] from='client.? 172.21.15.111:0/1190330541' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:19.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:19 smithi040 bash[17964]: audit 2024-02-22T19:03:18.567102+0000 mon.b (mon.2) 52 : audit [INF] from='client.? 172.21.15.111:0/3301025105' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:20.211 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:19 smithi111 bash[36204]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T19:03:20.211 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:19 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:03:20.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:20 smithi111 bash[14162]: cluster 2024-02-22T19:03:18.494890+0000 mgr.x (mgr.34862) 29 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:20.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:20 smithi040 bash[17964]: cluster 2024-02-22T19:03:18.494890+0000 mgr.x (mgr.34862) 29 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:20.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:20 smithi040 bash[13988]: cluster 2024-02-22T19:03:18.494890+0000 mgr.x (mgr.34862) 29 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:21.645Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:03:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:21.645Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:03:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:21.645Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:03:22.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:22 smithi040 bash[13988]: cluster 2024-02-22T19:03:20.496433+0000 mgr.x (mgr.34862) 30 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-22T19:03:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:22 smithi040 bash[17964]: cluster 2024-02-22T19:03:20.496433+0000 mgr.x (mgr.34862) 30 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-22T19:03:22.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:22 smithi111 bash[14162]: cluster 2024-02-22T19:03:20.496433+0000 mgr.x (mgr.34862) 30 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-22T19:03:24.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:24 smithi040 bash[13988]: cluster 2024-02-22T19:03:22.497111+0000 mgr.x (mgr.34862) 31 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:24.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:24 smithi040 bash[17964]: cluster 2024-02-22T19:03:22.497111+0000 mgr.x (mgr.34862) 31 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:24.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:24 smithi111 bash[14162]: cluster 2024-02-22T19:03:22.497111+0000 mgr.x (mgr.34862) 31 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:25.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:25 smithi040 bash[13988]: cluster 2024-02-22T19:03:24.498665+0000 mgr.x (mgr.34862) 32 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:25.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:25 smithi040 bash[17964]: cluster 2024-02-22T19:03:24.498665+0000 mgr.x (mgr.34862) 32 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:25.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:25 smithi111 bash[14162]: cluster 2024-02-22T19:03:24.498665+0000 mgr.x (mgr.34862) 32 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:28.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:28 smithi111 bash[14162]: cluster 2024-02-22T19:03:26.499442+0000 mgr.x (mgr.34862) 33 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:28.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:28 smithi040 bash[13988]: cluster 2024-02-22T19:03:26.499442+0000 mgr.x (mgr.34862) 33 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:28.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:28 smithi040 bash[17964]: cluster 2024-02-22T19:03:26.499442+0000 mgr.x (mgr.34862) 33 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:30.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:30 smithi111 bash[14162]: cluster 2024-02-22T19:03:28.500194+0000 mgr.x (mgr.34862) 34 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:30.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:29 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 3. 2024-02-22T19:03:30.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:29 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:03:30.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:29 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:03:30.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:30 smithi040 bash[13988]: cluster 2024-02-22T19:03:28.500194+0000 mgr.x (mgr.34862) 34 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:30.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:30 smithi040 bash[17964]: cluster 2024-02-22T19:03:28.500194+0000 mgr.x (mgr.34862) 34 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:31.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:31 smithi111 bash[36266]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T19:03:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:31.646Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:03:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:31.646Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:03:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:31.646Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:03:32.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[14162]: cluster 2024-02-22T19:03:30.501876+0000 mgr.x (mgr.34862) 35 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:32.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[14162]: audit 2024-02-22T19:03:32.006140+0000 mon.b (mon.2) 53 : audit [DBG] from='client.? 172.21.15.111:0/2043459100' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: --- Logging error --- 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.send(msg) 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.connect(address) 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:32.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self._connect_unixsocket(self.address) 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.connect(address) 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Call stack: 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self._bootstrap_inner() 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.run() 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: logger.info("Started the configuration object watcher") 2024-02-22T19:03:32.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Message: 'Started the configuration object watcher' 2024-02-22T19:03:32.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Arguments: () 2024-02-22T19:03:32.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: --- Logging error --- 2024-02-22T19:03:32.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:32.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.send(msg) 2024-02-22T19:03:32.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:32.467 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.connect(address) 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self._connect_unixsocket(self.address) 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.connect(address) 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Call stack: 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:32.468 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: main() 2024-02-22T19:03:32.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:32.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:32.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T19:03:32.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T19:03:32.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T19:03:32.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Arguments: () 2024-02-22T19:03:32.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: --- Logging error --- 2024-02-22T19:03:32.469 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.send(msg) 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.connect(address) 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self._connect_unixsocket(self.address) 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.connect(address) 2024-02-22T19:03:32.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Call stack: 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self._bootstrap_inner() 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.run() 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.interval)) 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Message: 'Checking for config object changes every 1s' 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Arguments: () 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: --- Logging error --- 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.send(msg) 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:32.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.connect(address) 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self._connect_unixsocket(self.address) 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: self.socket.connect(address) 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Call stack: 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: main() 2024-02-22T19:03:32.472 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: "{}".format(blacklisted_ip)) 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/3116463761' 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Arguments: () 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: Traceback (most recent call last): 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: main() 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T19:03:32.473 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T19:03:32.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T19:03:32.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: **kwargs).stdout 2024-02-22T19:03:32.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T19:03:32.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: output=stdout, stderr=stderr) 2024-02-22T19:03:32.474 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:32 smithi111 bash[36283]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/3116463761' returned non-zero exit status 13. 2024-02-22T19:03:32.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:32 smithi040 bash[13988]: cluster 2024-02-22T19:03:30.501876+0000 mgr.x (mgr.34862) 35 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:32.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:32 smithi040 bash[13988]: audit 2024-02-22T19:03:32.006140+0000 mon.b (mon.2) 53 : audit [DBG] from='client.? 172.21.15.111:0/2043459100' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:32.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:32 smithi040 bash[17964]: cluster 2024-02-22T19:03:30.501876+0000 mgr.x (mgr.34862) 35 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:32.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:32 smithi040 bash[17964]: audit 2024-02-22T19:03:32.006140+0000 mon.b (mon.2) 53 : audit [DBG] from='client.? 172.21.15.111:0/2043459100' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:33.409 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:33 smithi111 bash[14162]: audit 2024-02-22T19:03:32.338265+0000 mon.b (mon.2) 54 : audit [INF] from='client.? 172.21.15.111:0/2835660872' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:33.409 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:33 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:03:33.409 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:33 smithi111 bash[36266]: (process:1): GLib-GObject-CRITICAL **: 19:03:33.194: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T19:03:33.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:33 smithi040 bash[13988]: audit 2024-02-22T19:03:32.338265+0000 mon.b (mon.2) 54 : audit [INF] from='client.? 172.21.15.111:0/2835660872' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:33 smithi040 bash[17964]: audit 2024-02-22T19:03:32.338265+0000 mon.b (mon.2) 54 : audit [INF] from='client.? 172.21.15.111:0/2835660872' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:34.213 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:33 smithi111 bash[36491]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T19:03:34.213 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:33 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:03:34.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:34 smithi111 bash[14162]: cluster 2024-02-22T19:03:32.502644+0000 mgr.x (mgr.34862) 36 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:34.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:34 smithi040 bash[13988]: cluster 2024-02-22T19:03:32.502644+0000 mgr.x (mgr.34862) 36 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:34.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:34 smithi040 bash[17964]: cluster 2024-02-22T19:03:32.502644+0000 mgr.x (mgr.34862) 36 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:36.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:36 smithi040 bash[17964]: cluster 2024-02-22T19:03:34.504262+0000 mgr.x (mgr.34862) 37 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:36.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:36 smithi040 bash[13988]: cluster 2024-02-22T19:03:34.504262+0000 mgr.x (mgr.34862) 37 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:36.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:36 smithi111 bash[14162]: cluster 2024-02-22T19:03:34.504262+0000 mgr.x (mgr.34862) 37 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:38.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:38 smithi040 bash[17964]: cluster 2024-02-22T19:03:36.505166+0000 mgr.x (mgr.34862) 38 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:38.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:38 smithi040 bash[13988]: cluster 2024-02-22T19:03:36.505166+0000 mgr.x (mgr.34862) 38 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:38.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:38 smithi111 bash[14162]: cluster 2024-02-22T19:03:36.505166+0000 mgr.x (mgr.34862) 38 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:39.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:39 smithi040 bash[13988]: audit 2024-02-22T19:03:38.693856+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-22T19:03:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:39 smithi040 bash[13988]: audit 2024-02-22T19:03:38.694525+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-22T19:03:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:39 smithi040 bash[13988]: audit 2024-02-22T19:03:38.695170+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T19:03:39.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:39 smithi040 bash[17964]: audit 2024-02-22T19:03:38.693856+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-22T19:03:39.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:39 smithi040 bash[17964]: audit 2024-02-22T19:03:38.694525+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-22T19:03:39.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:39 smithi040 bash[17964]: audit 2024-02-22T19:03:38.695170+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T19:03:39.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:39 smithi111 bash[14162]: audit 2024-02-22T19:03:38.693856+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-22T19:03:39.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:39 smithi111 bash[14162]: audit 2024-02-22T19:03:38.694525+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-22T19:03:39.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:39 smithi111 bash[14162]: audit 2024-02-22T19:03:38.695170+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-22T19:03:40.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:40 smithi040 bash[17964]: cluster 2024-02-22T19:03:38.505962+0000 mgr.x (mgr.34862) 39 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:40.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:40 smithi040 bash[13988]: cluster 2024-02-22T19:03:38.505962+0000 mgr.x (mgr.34862) 39 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:40.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:40 smithi111 bash[14162]: cluster 2024-02-22T19:03:38.505962+0000 mgr.x (mgr.34862) 39 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:41.651 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:41 smithi040 bash[17964]: cluster 2024-02-22T19:03:40.507637+0000 mgr.x (mgr.34862) 40 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:41.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:41 smithi040 bash[13988]: cluster 2024-02-22T19:03:40.507637+0000 mgr.x (mgr.34862) 40 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:41 smithi111 bash[14162]: cluster 2024-02-22T19:03:40.507637+0000 mgr.x (mgr.34862) 40 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:41.646Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:03:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:41.646Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:03:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:41.646Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:03:44.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:44 smithi111 bash[14162]: cluster 2024-02-22T19:03:42.508353+0000 mgr.x (mgr.34862) 41 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:44.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:43 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 4. 2024-02-22T19:03:44.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:43 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:03:44.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:43 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:03:44.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:44 smithi040 bash[13988]: cluster 2024-02-22T19:03:42.508353+0000 mgr.x (mgr.34862) 41 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:44.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:44 smithi040 bash[17964]: cluster 2024-02-22T19:03:42.508353+0000 mgr.x (mgr.34862) 41 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:45.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:45 smithi111 bash[36551]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T19:03:46.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[14162]: cluster 2024-02-22T19:03:44.509789+0000 mgr.x (mgr.34862) 42 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:46.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[14162]: audit 2024-02-22T19:03:46.168367+0000 mon.b (mon.2) 55 : audit [DBG] from='client.? 172.21.15.111:0/2009768306' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:46.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:46 smithi040 bash[13988]: cluster 2024-02-22T19:03:44.509789+0000 mgr.x (mgr.34862) 42 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:46.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:46 smithi040 bash[13988]: audit 2024-02-22T19:03:46.168367+0000 mon.b (mon.2) 55 : audit [DBG] from='client.? 172.21.15.111:0/2009768306' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:46.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:46 smithi040 bash[17964]: cluster 2024-02-22T19:03:44.509789+0000 mgr.x (mgr.34862) 42 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:46.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:46 smithi040 bash[17964]: audit 2024-02-22T19:03:46.168367+0000 mon.b (mon.2) 55 : audit [DBG] from='client.? 172.21.15.111:0/2009768306' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: --- Logging error --- 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.send(msg) 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.connect(address) 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:46.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self._connect_unixsocket(self.address) 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.connect(address) 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Call stack: 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self._bootstrap_inner() 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.run() 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: logger.info("Started the configuration object watcher") 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Message: 'Started the configuration object watcher' 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Arguments: () 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: --- Logging error --- 2024-02-22T19:03:46.776 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.send(msg) 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.connect(address) 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self._connect_unixsocket(self.address) 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.connect(address) 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:46.777 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Call stack: 2024-02-22T19:03:46.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:46.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: main() 2024-02-22T19:03:46.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:46.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:46.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T19:03:46.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T19:03:46.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T19:03:46.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Arguments: () 2024-02-22T19:03:46.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: --- Logging error --- 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.send(msg) 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.connect(address) 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self._connect_unixsocket(self.address) 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:46.779 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.connect(address) 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Call stack: 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self._bootstrap_inner() 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.run() 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.interval)) 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Message: 'Checking for config object changes every 1s' 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Arguments: () 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: --- Logging error --- 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.780 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.send(msg) 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.connect(address) 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: During handling of the above exception, another exception occurred: 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self._connect_unixsocket(self.address) 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: self.socket.connect(address) 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:03:46.781 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Call stack: 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: main() 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: "{}".format(blacklisted_ip)) 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/3116463761' 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Arguments: () 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: Traceback (most recent call last): 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: main() 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:03:46.782 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:03:46.783 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:03:46.783 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T19:03:46.783 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T19:03:46.783 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T19:03:46.783 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: **kwargs).stdout 2024-02-22T19:03:46.783 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T19:03:46.783 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: output=stdout, stderr=stderr) 2024-02-22T19:03:46.783 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:46 smithi111 bash[36566]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/3116463761' returned non-zero exit status 13. 2024-02-22T19:03:47.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:47 smithi111 bash[14162]: audit 2024-02-22T19:03:46.503057+0000 mon.b (mon.2) 56 : audit [INF] from='client.? 172.21.15.111:0/3622491446' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:47.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:47 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:03:47.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:47 smithi111 bash[36551]: (process:1): GLib-GObject-CRITICAL **: 19:03:47.405: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T19:03:47.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:47 smithi040 bash[13988]: audit 2024-02-22T19:03:46.503057+0000 mon.b (mon.2) 56 : audit [INF] from='client.? 172.21.15.111:0/3622491446' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:47.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:47 smithi040 bash[17964]: audit 2024-02-22T19:03:46.503057+0000 mon.b (mon.2) 56 : audit [INF] from='client.? 172.21.15.111:0/3622491446' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:03:48.214 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:47 smithi111 bash[36782]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T19:03:48.214 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:47 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:03:48.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:48 smithi040 bash[13988]: cluster 2024-02-22T19:03:46.510599+0000 mgr.x (mgr.34862) 43 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:48.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:48 smithi040 bash[17964]: cluster 2024-02-22T19:03:46.510599+0000 mgr.x (mgr.34862) 43 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:48.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:48 smithi111 bash[14162]: cluster 2024-02-22T19:03:46.510599+0000 mgr.x (mgr.34862) 43 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:50.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:50 smithi040 bash[13988]: cluster 2024-02-22T19:03:48.511434+0000 mgr.x (mgr.34862) 44 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:50.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:50 smithi040 bash[17964]: cluster 2024-02-22T19:03:48.511434+0000 mgr.x (mgr.34862) 44 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:50.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:50 smithi111 bash[14162]: cluster 2024-02-22T19:03:48.511434+0000 mgr.x (mgr.34862) 44 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:03:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:51.646Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:03:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:51.646Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:03:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:03:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:03:51.647Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:03:52.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:52 smithi040 bash[13988]: cluster 2024-02-22T19:03:50.513069+0000 mgr.x (mgr.34862) 45 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:52.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:52 smithi040 bash[17964]: cluster 2024-02-22T19:03:50.513069+0000 mgr.x (mgr.34862) 45 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:52.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:52 smithi111 bash[14162]: cluster 2024-02-22T19:03:50.513069+0000 mgr.x (mgr.34862) 45 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:53.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:53 smithi040 bash[13988]: cluster 2024-02-22T19:03:52.513945+0000 mgr.x (mgr.34862) 46 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:53.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:53 smithi040 bash[17964]: cluster 2024-02-22T19:03:52.513945+0000 mgr.x (mgr.34862) 46 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:53.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:53 smithi111 bash[14162]: cluster 2024-02-22T19:03:52.513945+0000 mgr.x (mgr.34862) 46 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:55.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:55 smithi040 bash[17964]: cluster 2024-02-22T19:03:54.515453+0000 mgr.x (mgr.34862) 47 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:55.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:55 smithi040 bash[13988]: cluster 2024-02-22T19:03:54.515453+0000 mgr.x (mgr.34862) 47 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:55.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:55 smithi111 bash[14162]: cluster 2024-02-22T19:03:54.515453+0000 mgr.x (mgr.34862) 47 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:57.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[13988]: cluster 2024-02-22T19:03:56.516165+0000 mgr.x (mgr.34862) 48 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:57.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[13988]: audit 2024-02-22T19:03:56.775214+0000 mon.a (mon.0) 1041 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:03:57.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[13988]: audit 2024-02-22T19:03:56.777104+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:03:57.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[13988]: cephadm 2024-02-22T19:03:56.781068+0000 mgr.x (mgr.34862) 49 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:03:57.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[13988]: cluster 2024-02-22T19:03:56.781950+0000 mgr.x (mgr.34862) 50 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 99 B/s rd, 0 op/s 2024-02-22T19:03:57.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[13988]: cluster 2024-02-22T19:03:56.782284+0000 mgr.x (mgr.34862) 51 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 123 B/s rd, 0 op/s 2024-02-22T19:03:57.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[13988]: audit 2024-02-22T19:03:56.787827+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:03:57.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[17964]: cluster 2024-02-22T19:03:56.516165+0000 mgr.x (mgr.34862) 48 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:57.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[17964]: audit 2024-02-22T19:03:56.775214+0000 mon.a (mon.0) 1041 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:03:57.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[17964]: audit 2024-02-22T19:03:56.777104+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:03:57.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[17964]: cephadm 2024-02-22T19:03:56.781068+0000 mgr.x (mgr.34862) 49 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:03:57.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[17964]: cluster 2024-02-22T19:03:56.781950+0000 mgr.x (mgr.34862) 50 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 99 B/s rd, 0 op/s 2024-02-22T19:03:57.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[17964]: cluster 2024-02-22T19:03:56.782284+0000 mgr.x (mgr.34862) 51 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 123 B/s rd, 0 op/s 2024-02-22T19:03:57.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:57 smithi040 bash[17964]: audit 2024-02-22T19:03:56.787827+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:03:57.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:57 smithi111 bash[14162]: cluster 2024-02-22T19:03:56.516165+0000 mgr.x (mgr.34862) 48 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:03:57.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:57 smithi111 bash[14162]: audit 2024-02-22T19:03:56.775214+0000 mon.a (mon.0) 1041 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:03:57.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:57 smithi111 bash[14162]: audit 2024-02-22T19:03:56.777104+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:03:57.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:57 smithi111 bash[14162]: cephadm 2024-02-22T19:03:56.781068+0000 mgr.x (mgr.34862) 49 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:03:57.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:57 smithi111 bash[14162]: cluster 2024-02-22T19:03:56.781950+0000 mgr.x (mgr.34862) 50 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 99 B/s rd, 0 op/s 2024-02-22T19:03:57.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:57 smithi111 bash[14162]: cluster 2024-02-22T19:03:56.782284+0000 mgr.x (mgr.34862) 51 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 123 B/s rd, 0 op/s 2024-02-22T19:03:57.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:57 smithi111 bash[14162]: audit 2024-02-22T19:03:56.787827+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:03:58.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:57 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 5. 2024-02-22T19:03:58.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:57 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:03:58.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:57 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Start request repeated too quickly. 2024-02-22T19:03:58.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:57 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:03:58.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:03:57 smithi111 systemd[1]: Failed to start Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:04:00.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:03:59 smithi040 bash[13988]: cluster 2024-02-22T19:03:58.783640+0000 mgr.x (mgr.34862) 52 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:03:59 smithi040 bash[17964]: cluster 2024-02-22T19:03:58.783640+0000 mgr.x (mgr.34862) 52 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:00.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:03:59 smithi111 bash[14162]: cluster 2024-02-22T19:03:58.783640+0000 mgr.x (mgr.34862) 52 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:01.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:01 smithi040 bash[17964]: cluster 2024-02-22T19:04:00.784400+0000 mgr.x (mgr.34862) 53 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:01.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:01 smithi040 bash[13988]: cluster 2024-02-22T19:04:00.784400+0000 mgr.x (mgr.34862) 53 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:01.647Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:04:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:01.647Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:04:01.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:01.647Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:04:02.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:01 smithi111 bash[14162]: cluster 2024-02-22T19:04:00.784400+0000 mgr.x (mgr.34862) 53 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:04.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:04 smithi111 bash[14162]: cluster 2024-02-22T19:04:02.785138+0000 mgr.x (mgr.34862) 54 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:04.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:04 smithi040 bash[17964]: cluster 2024-02-22T19:04:02.785138+0000 mgr.x (mgr.34862) 54 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:04.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:04 smithi040 bash[13988]: cluster 2024-02-22T19:04:02.785138+0000 mgr.x (mgr.34862) 54 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:06.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:06 smithi111 bash[14162]: cluster 2024-02-22T19:04:04.786741+0000 mgr.x (mgr.34862) 55 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:06.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:06 smithi040 bash[17964]: cluster 2024-02-22T19:04:04.786741+0000 mgr.x (mgr.34862) 55 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:06.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:06 smithi040 bash[13988]: cluster 2024-02-22T19:04:04.786741+0000 mgr.x (mgr.34862) 55 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:08 smithi040 bash[17964]: cluster 2024-02-22T19:04:06.787565+0000 mgr.x (mgr.34862) 56 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:08 smithi040 bash[13988]: cluster 2024-02-22T19:04:06.787565+0000 mgr.x (mgr.34862) 56 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:08.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:08 smithi111 bash[14162]: cluster 2024-02-22T19:04:06.787565+0000 mgr.x (mgr.34862) 56 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:10.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:10 smithi040 bash[13988]: cluster 2024-02-22T19:04:08.789032+0000 mgr.x (mgr.34862) 57 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:10.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:10 smithi040 bash[17964]: cluster 2024-02-22T19:04:08.789032+0000 mgr.x (mgr.34862) 57 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:10.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:10 smithi111 bash[14162]: cluster 2024-02-22T19:04:08.789032+0000 mgr.x (mgr.34862) 57 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:11.647Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:04:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:11.647Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:04:11.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:11.647Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:04:12.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:12 smithi040 bash[13988]: cluster 2024-02-22T19:04:10.789762+0000 mgr.x (mgr.34862) 58 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:12.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:12 smithi040 bash[17964]: cluster 2024-02-22T19:04:10.789762+0000 mgr.x (mgr.34862) 58 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:12.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:12 smithi111 bash[14162]: cluster 2024-02-22T19:04:10.789762+0000 mgr.x (mgr.34862) 58 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:14.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:14 smithi040 bash[13988]: cluster 2024-02-22T19:04:12.790553+0000 mgr.x (mgr.34862) 59 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:14 smithi040 bash[17964]: cluster 2024-02-22T19:04:12.790553+0000 mgr.x (mgr.34862) 59 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:14.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:14 smithi111 bash[14162]: cluster 2024-02-22T19:04:12.790553+0000 mgr.x (mgr.34862) 59 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:15.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:15 smithi040 bash[17964]: cluster 2024-02-22T19:04:14.792113+0000 mgr.x (mgr.34862) 60 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:15 smithi040 bash[13988]: cluster 2024-02-22T19:04:14.792113+0000 mgr.x (mgr.34862) 60 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:15.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:15 smithi111 bash[14162]: cluster 2024-02-22T19:04:14.792113+0000 mgr.x (mgr.34862) 60 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:18.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:18 smithi111 bash[14162]: cluster 2024-02-22T19:04:16.792959+0000 mgr.x (mgr.34862) 61 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:18.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:18 smithi040 bash[17964]: cluster 2024-02-22T19:04:16.792959+0000 mgr.x (mgr.34862) 61 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:18.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:18 smithi040 bash[13988]: cluster 2024-02-22T19:04:16.792959+0000 mgr.x (mgr.34862) 61 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:20.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:20 smithi040 bash[17964]: cluster 2024-02-22T19:04:18.794524+0000 mgr.x (mgr.34862) 62 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:20.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:20 smithi040 bash[13988]: cluster 2024-02-22T19:04:18.794524+0000 mgr.x (mgr.34862) 62 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:20.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:20 smithi111 bash[14162]: cluster 2024-02-22T19:04:18.794524+0000 mgr.x (mgr.34862) 62 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:21.648Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:04:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:21.648Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:04:21.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:21.648Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:04:22.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:22 smithi040 bash[13988]: cluster 2024-02-22T19:04:20.795286+0000 mgr.x (mgr.34862) 63 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:22.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:22 smithi040 bash[17964]: cluster 2024-02-22T19:04:20.795286+0000 mgr.x (mgr.34862) 63 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:22.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:22 smithi111 bash[14162]: cluster 2024-02-22T19:04:20.795286+0000 mgr.x (mgr.34862) 63 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:24 smithi040 bash[13988]: cluster 2024-02-22T19:04:22.796050+0000 mgr.x (mgr.34862) 64 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:24.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:24 smithi040 bash[17964]: cluster 2024-02-22T19:04:22.796050+0000 mgr.x (mgr.34862) 64 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:24.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:24 smithi111 bash[14162]: cluster 2024-02-22T19:04:22.796050+0000 mgr.x (mgr.34862) 64 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:26.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:26 smithi040 bash[13988]: cluster 2024-02-22T19:04:24.797582+0000 mgr.x (mgr.34862) 65 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:26.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:26 smithi040 bash[17964]: cluster 2024-02-22T19:04:24.797582+0000 mgr.x (mgr.34862) 65 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:26.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:26 smithi111 bash[14162]: cluster 2024-02-22T19:04:24.797582+0000 mgr.x (mgr.34862) 65 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:28.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:28 smithi040 bash[13988]: cluster 2024-02-22T19:04:26.798333+0000 mgr.x (mgr.34862) 66 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:28.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:28 smithi040 bash[17964]: cluster 2024-02-22T19:04:26.798333+0000 mgr.x (mgr.34862) 66 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:28.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:28 smithi111 bash[14162]: cluster 2024-02-22T19:04:26.798333+0000 mgr.x (mgr.34862) 66 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:29.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:29 smithi040 bash[13988]: cluster 2024-02-22T19:04:28.800610+0000 mgr.x (mgr.34862) 67 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:29.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:29 smithi040 bash[17964]: cluster 2024-02-22T19:04:28.800610+0000 mgr.x (mgr.34862) 67 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:29.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:29 smithi111 bash[14162]: cluster 2024-02-22T19:04:28.800610+0000 mgr.x (mgr.34862) 67 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:31.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:31 smithi040 bash[13988]: cluster 2024-02-22T19:04:30.801352+0000 mgr.x (mgr.34862) 68 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:31.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:31 smithi040 bash[17964]: cluster 2024-02-22T19:04:30.801352+0000 mgr.x (mgr.34862) 68 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:31.648Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:04:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:31.648Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:04:31.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:31.648Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:04:32.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:31 smithi111 bash[14162]: cluster 2024-02-22T19:04:30.801352+0000 mgr.x (mgr.34862) 68 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:34.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:34 smithi040 bash[13988]: cluster 2024-02-22T19:04:32.802123+0000 mgr.x (mgr.34862) 69 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:34.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:34 smithi040 bash[17964]: cluster 2024-02-22T19:04:32.802123+0000 mgr.x (mgr.34862) 69 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:34.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:34 smithi111 bash[14162]: cluster 2024-02-22T19:04:32.802123+0000 mgr.x (mgr.34862) 69 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:36.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:36 smithi040 bash[13988]: cluster 2024-02-22T19:04:34.803632+0000 mgr.x (mgr.34862) 70 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:36.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:36 smithi040 bash[17964]: cluster 2024-02-22T19:04:34.803632+0000 mgr.x (mgr.34862) 70 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:36.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:36 smithi111 bash[14162]: cluster 2024-02-22T19:04:34.803632+0000 mgr.x (mgr.34862) 70 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:38.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:38 smithi040 bash[13988]: cluster 2024-02-22T19:04:36.804255+0000 mgr.x (mgr.34862) 71 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:38.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:38 smithi040 bash[17964]: cluster 2024-02-22T19:04:36.804255+0000 mgr.x (mgr.34862) 71 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:38.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:38 smithi111 bash[14162]: cluster 2024-02-22T19:04:36.804255+0000 mgr.x (mgr.34862) 71 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:39.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:39 smithi040 bash[13988]: audit 2024-02-22T19:04:38.702241+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2024-02-22T19:04:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:39 smithi040 bash[13988]: audit 2024-02-22T19:04:38.702863+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T19:04:39.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:39 smithi040 bash[13988]: audit 2024-02-22T19:04:38.703403+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-22T19:04:39.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:39 smithi040 bash[17964]: audit 2024-02-22T19:04:38.702241+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2024-02-22T19:04:39.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:39 smithi040 bash[17964]: audit 2024-02-22T19:04:38.702863+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T19:04:39.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:39 smithi040 bash[17964]: audit 2024-02-22T19:04:38.703403+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-22T19:04:39.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:39 smithi111 bash[14162]: audit 2024-02-22T19:04:38.702241+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2024-02-22T19:04:39.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:39 smithi111 bash[14162]: audit 2024-02-22T19:04:38.702863+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-22T19:04:39.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:39 smithi111 bash[14162]: audit 2024-02-22T19:04:38.703403+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-22T19:04:40.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:40 smithi040 bash[13988]: cluster 2024-02-22T19:04:38.805619+0000 mgr.x (mgr.34862) 72 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:40.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:40 smithi040 bash[17964]: cluster 2024-02-22T19:04:38.805619+0000 mgr.x (mgr.34862) 72 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:40.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:40 smithi111 bash[14162]: cluster 2024-02-22T19:04:38.805619+0000 mgr.x (mgr.34862) 72 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:41.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:41 smithi040 bash[13988]: cluster 2024-02-22T19:04:40.806353+0000 mgr.x (mgr.34862) 73 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:41.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:41 smithi040 bash[17964]: cluster 2024-02-22T19:04:40.806353+0000 mgr.x (mgr.34862) 73 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:41 smithi111 bash[14162]: cluster 2024-02-22T19:04:40.806353+0000 mgr.x (mgr.34862) 73 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:41.648Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:04:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:41.648Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:04:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:41.648Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:04:44.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:44 smithi040 bash[13988]: cluster 2024-02-22T19:04:42.807147+0000 mgr.x (mgr.34862) 74 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:44.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:44 smithi040 bash[17964]: cluster 2024-02-22T19:04:42.807147+0000 mgr.x (mgr.34862) 74 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:44.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:44 smithi111 bash[14162]: cluster 2024-02-22T19:04:42.807147+0000 mgr.x (mgr.34862) 74 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:46.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:46 smithi040 bash[13988]: cluster 2024-02-22T19:04:44.808639+0000 mgr.x (mgr.34862) 75 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:46.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:46 smithi040 bash[17964]: cluster 2024-02-22T19:04:44.808639+0000 mgr.x (mgr.34862) 75 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:46.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:46 smithi111 bash[14162]: cluster 2024-02-22T19:04:44.808639+0000 mgr.x (mgr.34862) 75 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:48.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:48 smithi040 bash[13988]: cluster 2024-02-22T19:04:46.809392+0000 mgr.x (mgr.34862) 76 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:48.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:48 smithi040 bash[17964]: cluster 2024-02-22T19:04:46.809392+0000 mgr.x (mgr.34862) 76 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:48.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:48 smithi111 bash[14162]: cluster 2024-02-22T19:04:46.809392+0000 mgr.x (mgr.34862) 76 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:50.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:50 smithi040 bash[13988]: cluster 2024-02-22T19:04:48.810883+0000 mgr.x (mgr.34862) 77 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:50.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:50 smithi040 bash[17964]: cluster 2024-02-22T19:04:48.810883+0000 mgr.x (mgr.34862) 77 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:50.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:50 smithi111 bash[14162]: cluster 2024-02-22T19:04:48.810883+0000 mgr.x (mgr.34862) 77 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:51.649Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:04:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:51.649Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:04:51.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:04:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:04:51.649Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:04:52.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:52 smithi040 bash[17964]: cluster 2024-02-22T19:04:50.811721+0000 mgr.x (mgr.34862) 78 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:52.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:52 smithi040 bash[13988]: cluster 2024-02-22T19:04:50.811721+0000 mgr.x (mgr.34862) 78 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:52.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:52 smithi111 bash[14162]: cluster 2024-02-22T19:04:50.811721+0000 mgr.x (mgr.34862) 78 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:53.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:53 smithi040 bash[17964]: cluster 2024-02-22T19:04:52.812394+0000 mgr.x (mgr.34862) 79 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:53.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:53 smithi040 bash[13988]: cluster 2024-02-22T19:04:52.812394+0000 mgr.x (mgr.34862) 79 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:53.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:53 smithi111 bash[14162]: cluster 2024-02-22T19:04:52.812394+0000 mgr.x (mgr.34862) 79 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:56.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:55 smithi040 bash[17964]: cluster 2024-02-22T19:04:54.813883+0000 mgr.x (mgr.34862) 80 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:56.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:55 smithi040 bash[13988]: cluster 2024-02-22T19:04:54.813883+0000 mgr.x (mgr.34862) 80 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:56.214 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:55 smithi111 bash[14162]: cluster 2024-02-22T19:04:54.813883+0000 mgr.x (mgr.34862) 80 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[13988]: cluster 2024-02-22T19:04:56.814593+0000 mgr.x (mgr.34862) 81 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[13988]: audit 2024-02-22T19:04:57.099038+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[13988]: audit 2024-02-22T19:04:57.101209+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[13988]: cephadm 2024-02-22T19:04:57.105575+0000 mgr.x (mgr.34862) 82 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[13988]: cluster 2024-02-22T19:04:57.106597+0000 mgr.x (mgr.34862) 83 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[13988]: cluster 2024-02-22T19:04:57.107235+0000 mgr.x (mgr.34862) 84 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[13988]: audit 2024-02-22T19:04:57.114063+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[17964]: cluster 2024-02-22T19:04:56.814593+0000 mgr.x (mgr.34862) 81 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[17964]: audit 2024-02-22T19:04:57.099038+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[17964]: audit 2024-02-22T19:04:57.101209+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[17964]: cephadm 2024-02-22T19:04:57.105575+0000 mgr.x (mgr.34862) 82 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[17964]: cluster 2024-02-22T19:04:57.106597+0000 mgr.x (mgr.34862) 83 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[17964]: cluster 2024-02-22T19:04:57.107235+0000 mgr.x (mgr.34862) 84 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:04:57 smithi040 bash[17964]: audit 2024-02-22T19:04:57.114063+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:04:58.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:57 smithi111 bash[14162]: cluster 2024-02-22T19:04:56.814593+0000 mgr.x (mgr.34862) 81 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:57 smithi111 bash[14162]: audit 2024-02-22T19:04:57.099038+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:58.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:57 smithi111 bash[14162]: audit 2024-02-22T19:04:57.101209+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:04:58.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:57 smithi111 bash[14162]: cephadm 2024-02-22T19:04:57.105575+0000 mgr.x (mgr.34862) 82 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:04:58.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:57 smithi111 bash[14162]: cluster 2024-02-22T19:04:57.106597+0000 mgr.x (mgr.34862) 83 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:57 smithi111 bash[14162]: cluster 2024-02-22T19:04:57.107235+0000 mgr.x (mgr.34862) 84 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:04:58.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:04:57 smithi111 bash[14162]: audit 2024-02-22T19:04:57.114063+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:00.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:00 smithi040 bash[13988]: cluster 2024-02-22T19:04:59.108714+0000 mgr.x (mgr.34862) 85 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:00.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:00 smithi040 bash[17964]: cluster 2024-02-22T19:04:59.108714+0000 mgr.x (mgr.34862) 85 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:00.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:00 smithi111 bash[14162]: cluster 2024-02-22T19:04:59.108714+0000 mgr.x (mgr.34862) 85 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:01.649Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:05:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:01.649Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:05:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:01.649Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:05:02.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:02 smithi040 bash[13988]: cluster 2024-02-22T19:05:01.109462+0000 mgr.x (mgr.34862) 86 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:02.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:02 smithi040 bash[17964]: cluster 2024-02-22T19:05:01.109462+0000 mgr.x (mgr.34862) 86 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:02.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:02 smithi111 bash[14162]: cluster 2024-02-22T19:05:01.109462+0000 mgr.x (mgr.34862) 86 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:04.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:04 smithi040 bash[13988]: cluster 2024-02-22T19:05:03.110222+0000 mgr.x (mgr.34862) 87 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:04.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:04 smithi040 bash[17964]: cluster 2024-02-22T19:05:03.110222+0000 mgr.x (mgr.34862) 87 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:04.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:04 smithi111 bash[14162]: cluster 2024-02-22T19:05:03.110222+0000 mgr.x (mgr.34862) 87 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:06.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:06 smithi040 bash[13988]: cluster 2024-02-22T19:05:05.111731+0000 mgr.x (mgr.34862) 88 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:06.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:06 smithi040 bash[17964]: cluster 2024-02-22T19:05:05.111731+0000 mgr.x (mgr.34862) 88 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:06.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:06 smithi111 bash[14162]: cluster 2024-02-22T19:05:05.111731+0000 mgr.x (mgr.34862) 88 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:08.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:08 smithi040 bash[13988]: cluster 2024-02-22T19:05:07.112493+0000 mgr.x (mgr.34862) 89 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:08.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:08 smithi040 bash[17964]: cluster 2024-02-22T19:05:07.112493+0000 mgr.x (mgr.34862) 89 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:08.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:08 smithi111 bash[14162]: cluster 2024-02-22T19:05:07.112493+0000 mgr.x (mgr.34862) 89 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:09.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:09 smithi040 bash[13988]: cluster 2024-02-22T19:05:09.114108+0000 mgr.x (mgr.34862) 90 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:09 smithi040 bash[17964]: cluster 2024-02-22T19:05:09.114108+0000 mgr.x (mgr.34862) 90 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:09.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:09 smithi111 bash[14162]: cluster 2024-02-22T19:05:09.114108+0000 mgr.x (mgr.34862) 90 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:11.650Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:05:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:11.650Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:05:11.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:11.650Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:05:12.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:12 smithi040 bash[13988]: cluster 2024-02-22T19:05:11.114890+0000 mgr.x (mgr.34862) 91 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:12.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:12 smithi040 bash[17964]: cluster 2024-02-22T19:05:11.114890+0000 mgr.x (mgr.34862) 91 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:12.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:12 smithi111 bash[14162]: cluster 2024-02-22T19:05:11.114890+0000 mgr.x (mgr.34862) 91 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:13.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:13 smithi040 bash[13988]: cluster 2024-02-22T19:05:13.115731+0000 mgr.x (mgr.34862) 92 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:13.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:13 smithi040 bash[17964]: cluster 2024-02-22T19:05:13.115731+0000 mgr.x (mgr.34862) 92 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:13.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:13 smithi111 bash[14162]: cluster 2024-02-22T19:05:13.115731+0000 mgr.x (mgr.34862) 92 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:16.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:16 smithi040 bash[17964]: cluster 2024-02-22T19:05:15.117251+0000 mgr.x (mgr.34862) 93 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:16 smithi040 bash[13988]: cluster 2024-02-22T19:05:15.117251+0000 mgr.x (mgr.34862) 93 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:16.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:16 smithi111 bash[14162]: cluster 2024-02-22T19:05:15.117251+0000 mgr.x (mgr.34862) 93 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:18 smithi040 bash[13988]: cluster 2024-02-22T19:05:17.117986+0000 mgr.x (mgr.34862) 94 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:18 smithi040 bash[17964]: cluster 2024-02-22T19:05:17.117986+0000 mgr.x (mgr.34862) 94 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:18.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:18 smithi111 bash[14162]: cluster 2024-02-22T19:05:17.117986+0000 mgr.x (mgr.34862) 94 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:19.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:19 smithi040 bash[17964]: cluster 2024-02-22T19:05:19.119490+0000 mgr.x (mgr.34862) 95 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:19.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:19 smithi040 bash[13988]: cluster 2024-02-22T19:05:19.119490+0000 mgr.x (mgr.34862) 95 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:19.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:19 smithi111 bash[14162]: cluster 2024-02-22T19:05:19.119490+0000 mgr.x (mgr.34862) 95 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:21.650Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:05:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:21.650Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:05:21.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:21.650Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:05:22.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:22 smithi040 bash[13988]: cluster 2024-02-22T19:05:21.120236+0000 mgr.x (mgr.34862) 96 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:22.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:22 smithi040 bash[17964]: cluster 2024-02-22T19:05:21.120236+0000 mgr.x (mgr.34862) 96 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:22.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:22 smithi111 bash[14162]: cluster 2024-02-22T19:05:21.120236+0000 mgr.x (mgr.34862) 96 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:24.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:24 smithi040 bash[13988]: cluster 2024-02-22T19:05:23.120987+0000 mgr.x (mgr.34862) 97 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:24.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:24 smithi040 bash[17964]: cluster 2024-02-22T19:05:23.120987+0000 mgr.x (mgr.34862) 97 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:24.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:24 smithi111 bash[14162]: cluster 2024-02-22T19:05:23.120987+0000 mgr.x (mgr.34862) 97 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:25.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:25 smithi040 bash[13988]: cluster 2024-02-22T19:05:25.122572+0000 mgr.x (mgr.34862) 98 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:25.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:25 smithi040 bash[17964]: cluster 2024-02-22T19:05:25.122572+0000 mgr.x (mgr.34862) 98 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:25.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:25 smithi111 bash[14162]: cluster 2024-02-22T19:05:25.122572+0000 mgr.x (mgr.34862) 98 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:28.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:28 smithi040 bash[13988]: cluster 2024-02-22T19:05:27.123466+0000 mgr.x (mgr.34862) 99 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:28.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:28 smithi040 bash[17964]: cluster 2024-02-22T19:05:27.123466+0000 mgr.x (mgr.34862) 99 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:28.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:28 smithi111 bash[14162]: cluster 2024-02-22T19:05:27.123466+0000 mgr.x (mgr.34862) 99 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:29.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:29 smithi040 bash[13988]: cluster 2024-02-22T19:05:29.124893+0000 mgr.x (mgr.34862) 100 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-22T19:05:29.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:29 smithi040 bash[17964]: cluster 2024-02-22T19:05:29.124893+0000 mgr.x (mgr.34862) 100 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-22T19:05:29.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:29 smithi111 bash[14162]: cluster 2024-02-22T19:05:29.124893+0000 mgr.x (mgr.34862) 100 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-22T19:05:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:31.650Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:05:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:31.650Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:05:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:31.650Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:05:32.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:32 smithi111 bash[14162]: cluster 2024-02-22T19:05:31.125699+0000 mgr.x (mgr.34862) 101 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-22T19:05:32.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:32 smithi040 bash[17964]: cluster 2024-02-22T19:05:31.125699+0000 mgr.x (mgr.34862) 101 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-22T19:05:32.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:32 smithi040 bash[13988]: cluster 2024-02-22T19:05:31.125699+0000 mgr.x (mgr.34862) 101 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-22T19:05:34.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:34 smithi040 bash[13988]: cluster 2024-02-22T19:05:33.126443+0000 mgr.x (mgr.34862) 102 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-22T19:05:34.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:34 smithi040 bash[17964]: cluster 2024-02-22T19:05:33.126443+0000 mgr.x (mgr.34862) 102 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-22T19:05:34.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:34 smithi111 bash[14162]: cluster 2024-02-22T19:05:33.126443+0000 mgr.x (mgr.34862) 102 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-22T19:05:35.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:35 smithi040 bash[13988]: cluster 2024-02-22T19:05:35.127951+0000 mgr.x (mgr.34862) 103 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T19:05:35.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:35 smithi040 bash[17964]: cluster 2024-02-22T19:05:35.127951+0000 mgr.x (mgr.34862) 103 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T19:05:35.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:35 smithi111 bash[14162]: cluster 2024-02-22T19:05:35.127951+0000 mgr.x (mgr.34862) 103 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T19:05:37.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ps' 2024-02-22T19:05:38.538 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:38 smithi040 bash[13988]: cluster 2024-02-22T19:05:37.128716+0000 mgr.x (mgr.34862) 104 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T19:05:38.538 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:38 smithi040 bash[17964]: cluster 2024-02-22T19:05:37.128716+0000 mgr.x (mgr.34862) 104 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T19:05:38.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:38 smithi111 bash[14162]: cluster 2024-02-22T19:05:37.128716+0000 mgr.x (mgr.34862) 104 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T19:05:39.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:39 smithi040 bash[13988]: audit 2024-02-22T19:05:38.711175+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-22T19:05:39.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:39 smithi040 bash[13988]: audit 2024-02-22T19:05:38.711853+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2024-02-22T19:05:39.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:39 smithi040 bash[13988]: audit 2024-02-22T19:05:38.712459+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-22T19:05:39.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:39 smithi040 bash[17964]: audit 2024-02-22T19:05:38.711175+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-22T19:05:39.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:39 smithi040 bash[17964]: audit 2024-02-22T19:05:38.711853+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2024-02-22T19:05:39.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:39 smithi040 bash[17964]: audit 2024-02-22T19:05:38.712459+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-22T19:05:39.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:39 smithi111 bash[14162]: audit 2024-02-22T19:05:38.711175+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-22T19:05:39.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:39 smithi111 bash[14162]: audit 2024-02-22T19:05:38.711853+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2024-02-22T19:05:39.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:39 smithi111 bash[14162]: audit 2024-02-22T19:05:38.712459+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-22T19:05:40.525 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:40 smithi040 bash[13988]: cluster 2024-02-22T19:05:39.130252+0000 mgr.x (mgr.34862) 105 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T19:05:40.525 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:40 smithi040 bash[17964]: cluster 2024-02-22T19:05:39.130252+0000 mgr.x (mgr.34862) 105 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T19:05:40.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:40 smithi111 bash[14162]: cluster 2024-02-22T19:05:39.130252+0000 mgr.x (mgr.34862) 105 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (21m) 2m ago 22m 14.8M - 0.20.0 0881eb8f169f d07d332bcae5 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi111 running (21m) 2m ago 21m 27.9M - 6.6.2 a0dce381714a 5ee787fea36d 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi.iscsi.a smithi111 error 2m ago 22m - - 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi111 running (15m) 2m ago 26m 411M - 16.2.14-550-geb66ed92 7403d1862307 a875afad2b64 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (9m) 2m ago 28m 377M - 16.2.14-550-geb66ed92 7403d1862307 439ee1bc8662 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (28m) 2m ago 28m 87.4M 2048M 15.2.9 dfc483079636 3c89b7663858 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi111 running (26m) 2m ago 26m 63.8M 2048M 15.2.9 dfc483079636 336462e9a5d0 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (26m) 2m ago 26m 61.6M 2048M 15.2.9 dfc483079636 1f9be7bcd2e0 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (22m) 2m ago 22m 12.0M - 0.18.1 e5a616e4b9cf 3facd7c224ee 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi111 running (22m) 2m ago 22m 12.4M - 0.18.1 e5a616e4b9cf e0f6df3dcf29 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (26m) 2m ago 26m 46.8M 4096M 15.2.9 dfc483079636 6caadfc43004 2024-02-22T19:05:40.890 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (25m) 2m ago 25m 47.9M 4096M 15.2.9 dfc483079636 c752ecdf2341 2024-02-22T19:05:40.891 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (25m) 2m ago 25m 43.9M 4096M 15.2.9 dfc483079636 fa43ac3dae85 2024-02-22T19:05:40.891 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (24m) 2m ago 24m 49.3M 4096M 15.2.9 dfc483079636 df5809aeb58e 2024-02-22T19:05:40.891 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi111 running (24m) 2m ago 24m 47.8M 4096M 15.2.9 dfc483079636 88b0bb37dbaf 2024-02-22T19:05:40.891 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi111 running (24m) 2m ago 24m 46.1M 4096M 15.2.9 dfc483079636 0e91fba2eb35 2024-02-22T19:05:40.891 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi111 running (23m) 2m ago 23m 45.2M 4096M 15.2.9 dfc483079636 7bc8f399b295 2024-02-22T19:05:40.891 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi111 running (23m) 2m ago 23m 46.5M 4096M 15.2.9 dfc483079636 59b477b24a62 2024-02-22T19:05:40.891 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi111 running (12m) 2m ago 22m 44.7M - 2.18.1 de242295e225 88a0cc7fd66c 2024-02-22T19:05:40.891 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.pyjfss smithi040 running (20m) 2m ago 20m 52.7M - 15.2.9 dfc483079636 47df35fb3739 2024-02-22T19:05:40.891 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi111.qafphs smithi111 running (20m) 2m ago 20m 52.7M - 15.2.9 dfc483079636 80fcb09b20c7 2024-02-22T19:05:41.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.849335+0000 mgr.x (mgr.34862) 106 : audit [DBG] from='client.25168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.852881+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.854146+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.855307+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.856534+0000 mon.a (mon.0) 1056 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.857741+0000 mon.a (mon.0) 1057 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.858993+0000 mon.a (mon.0) 1058 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.864717+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.865966+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.867242+0000 mon.a (mon.0) 1061 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.868362+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: audit 2024-02-22T19:05:40.869497+0000 mon.a (mon.0) 1063 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[13988]: cluster 2024-02-22T19:05:41.131011+0000 mgr.x (mgr.34862) 107 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 112 op/s 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.849335+0000 mgr.x (mgr.34862) 106 : audit [DBG] from='client.25168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.852881+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.854146+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.855307+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.856534+0000 mon.a (mon.0) 1056 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.857741+0000 mon.a (mon.0) 1057 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.858993+0000 mon.a (mon.0) 1058 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.864717+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.865966+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.867242+0000 mon.a (mon.0) 1061 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.868362+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: audit 2024-02-22T19:05:40.869497+0000 mon.a (mon.0) 1063 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[17964]: cluster 2024-02-22T19:05:41.131011+0000 mgr.x (mgr.34862) 107 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 112 op/s 2024-02-22T19:05:41.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions' 2024-02-22T19:05:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.849335+0000 mgr.x (mgr.34862) 106 : audit [DBG] from='client.25168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.852881+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:05:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.854146+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:05:41.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.855307+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.856534+0000 mon.a (mon.0) 1056 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.857741+0000 mon.a (mon.0) 1057 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.858993+0000 mon.a (mon.0) 1058 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.864717+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:05:41.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.865966+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.867242+0000 mon.a (mon.0) 1061 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.868362+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: audit 2024-02-22T19:05:40.869497+0000 mon.a (mon.0) 1063 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:05:41.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:41 smithi111 bash[14162]: cluster 2024-02-22T19:05:41.131011+0000 mgr.x (mgr.34862) 107 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 112 op/s 2024-02-22T19:05:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:41.651Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:05:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:41.651Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:05:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:41.651Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:05:43.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:43 smithi040 bash[13988]: cluster 2024-02-22T19:05:43.131768+0000 mgr.x (mgr.34862) 108 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 112 op/s 2024-02-22T19:05:43.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:43 smithi040 bash[17964]: cluster 2024-02-22T19:05:43.131768+0000 mgr.x (mgr.34862) 108 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 112 op/s 2024-02-22T19:05:43.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:43 smithi111 bash[14162]: cluster 2024-02-22T19:05:43.131768+0000 mgr.x (mgr.34862) 108 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 112 op/s 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 3 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 8 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-22T19:05:45.000 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-22T19:05:45.001 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 2 2024-02-22T19:05:45.001 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-22T19:05:45.001 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-22T19:05:45.001 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.9 (357616cbf726abb779ca75a551e8d02568e15b17) octopus (stable)": 13, 2024-02-22T19:05:45.001 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T19:05:45.001 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-22T19:05:45.001 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-22T19:05:45.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:45 smithi040 bash[13988]: audit 2024-02-22T19:05:44.995415+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.15.40:0/2455232134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:05:45.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:45 smithi040 bash[17964]: audit 2024-02-22T19:05:44.995415+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.15.40:0/2455232134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:05:45.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:45 smithi111 bash[14162]: audit 2024-02-22T19:05:44.995415+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.15.40:0/2455232134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:05:45.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-22T19:05:46.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:46 smithi040 bash[13988]: cluster 2024-02-22T19:05:45.133415+0000 mgr.x (mgr.34862) 109 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 112 op/s 2024-02-22T19:05:46.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:46 smithi040 bash[17964]: cluster 2024-02-22T19:05:45.133415+0000 mgr.x (mgr.34862) 109 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 112 op/s 2024-02-22T19:05:46.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:46 smithi111 bash[14162]: cluster 2024-02-22T19:05:45.133415+0000 mgr.x (mgr.34862) 109 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 112 op/s 2024-02-22T19:05:48.623 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:48 smithi040 bash[17964]: cluster 2024-02-22T19:05:47.134287+0000 mgr.x (mgr.34862) 110 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:48.623 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:48 smithi040 bash[13988]: cluster 2024-02-22T19:05:47.134287+0000 mgr.x (mgr.34862) 110 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:48.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:48 smithi111 bash[14162]: cluster 2024-02-22T19:05:47.134287+0000 mgr.x (mgr.34862) 110 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:49.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:49 smithi040 bash[13988]: audit 2024-02-22T19:05:49.033036+0000 mgr.x (mgr.34862) 111 : audit [DBG] from='client.25180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:49.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:49 smithi040 bash[13988]: cluster 2024-02-22T19:05:49.136110+0000 mgr.x (mgr.34862) 112 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:49.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:49 smithi040 bash[17964]: audit 2024-02-22T19:05:49.033036+0000 mgr.x (mgr.34862) 111 : audit [DBG] from='client.25180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:49.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:49 smithi040 bash[17964]: cluster 2024-02-22T19:05:49.136110+0000 mgr.x (mgr.34862) 112 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:49.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:49 smithi111 bash[14162]: audit 2024-02-22T19:05:49.033036+0000 mgr.x (mgr.34862) 111 : audit [DBG] from='client.25180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:49.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:49 smithi111 bash[14162]: cluster 2024-02-22T19:05:49.136110+0000 mgr.x (mgr.34862) 112 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:51.142 INFO:teuthology.orchestra.run.smithi040.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:05:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:51.651Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:05:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:51.651Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:05:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:05:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:05:51.651Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:05:52.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-22T19:05:52.402 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: cephadm 2024-02-22T19:05:51.131763+0000 mgr.x (mgr.34862) 113 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:05:52.402 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: cluster 2024-02-22T19:05:51.136999+0000 mgr.x (mgr.34862) 114 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:52.402 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: audit 2024-02-22T19:05:51.137292+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:52.402 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: audit 2024-02-22T19:05:51.147910+0000 mon.a (mon.0) 1065 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:52.402 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: audit 2024-02-22T19:05:51.150165+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:05:52.402 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: cephadm 2024-02-22T19:05:51.154454+0000 mgr.x (mgr.34862) 115 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:05:52.402 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: cluster 2024-02-22T19:05:51.155674+0000 mgr.x (mgr.34862) 116 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: cluster 2024-02-22T19:05:51.156149+0000 mgr.x (mgr.34862) 117 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: audit 2024-02-22T19:05:51.160694+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[17964]: cephadm 2024-02-22T19:05:51.177967+0000 mgr.x (mgr.34862) 118 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: cephadm 2024-02-22T19:05:51.131763+0000 mgr.x (mgr.34862) 113 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: cluster 2024-02-22T19:05:51.136999+0000 mgr.x (mgr.34862) 114 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: audit 2024-02-22T19:05:51.137292+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: audit 2024-02-22T19:05:51.147910+0000 mon.a (mon.0) 1065 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: audit 2024-02-22T19:05:51.150165+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: cephadm 2024-02-22T19:05:51.154454+0000 mgr.x (mgr.34862) 115 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: cluster 2024-02-22T19:05:51.155674+0000 mgr.x (mgr.34862) 116 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: cluster 2024-02-22T19:05:51.156149+0000 mgr.x (mgr.34862) 117 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: audit 2024-02-22T19:05:51.160694+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:52.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:52 smithi040 bash[13988]: cephadm 2024-02-22T19:05:51.177967+0000 mgr.x (mgr.34862) 118 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:05:52.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: cephadm 2024-02-22T19:05:51.131763+0000 mgr.x (mgr.34862) 113 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:05:52.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: cluster 2024-02-22T19:05:51.136999+0000 mgr.x (mgr.34862) 114 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: audit 2024-02-22T19:05:51.137292+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: audit 2024-02-22T19:05:51.147910+0000 mon.a (mon.0) 1065 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: audit 2024-02-22T19:05:51.150165+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:05:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: cephadm 2024-02-22T19:05:51.154454+0000 mgr.x (mgr.34862) 115 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:05:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: cluster 2024-02-22T19:05:51.155674+0000 mgr.x (mgr.34862) 116 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: cluster 2024-02-22T19:05:51.156149+0000 mgr.x (mgr.34862) 117 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: audit 2024-02-22T19:05:51.160694+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:52.465 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:52 smithi111 bash[14162]: cephadm 2024-02-22T19:05:51.177967+0000 mgr.x (mgr.34862) 118 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:05:53.373 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:53 smithi040 bash[13988]: cluster 2024-02-22T19:05:53.156877+0000 mgr.x (mgr.34862) 119 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:53.374 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:53 smithi040 bash[17964]: cluster 2024-02-22T19:05:53.156877+0000 mgr.x (mgr.34862) 119 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:53.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:53 smithi111 bash[14162]: cluster 2024-02-22T19:05:53.156877+0000 mgr.x (mgr.34862) 119 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:55.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: audit 2024-02-22T19:05:54.321468+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:55.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: cephadm 2024-02-22T19:05:54.324742+0000 mgr.x (mgr.34862) 120 : cephadm [INF] Upgrade: Target is version 16.2.14-550-geb66ed92 (pacific) 2024-02-22T19:05:55.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: cephadm 2024-02-22T19:05:54.325005+0000 mgr.x (mgr.34862) 121 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59, digests ['quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010'] 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: audit 2024-02-22T19:05:54.325660+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: audit 2024-02-22T19:05:54.332462+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: cephadm 2024-02-22T19:05:54.337167+0000 mgr.x (mgr.34862) 122 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: cephadm 2024-02-22T19:05:54.338621+0000 mgr.x (mgr.34862) 123 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: audit 2024-02-22T19:05:54.341081+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: cephadm 2024-02-22T19:05:54.342967+0000 mgr.x (mgr.34862) 124 : cephadm [INF] Failing over to other MGR 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: cluster 2024-02-22T19:05:54.347724+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: audit 2024-02-22T19:05:54.351863+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: audit 2024-02-22T19:05:54.353202+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:05:55.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[13988]: cluster 2024-02-22T19:05:55.157636+0000 mgr.x (mgr.34862) 125 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: audit 2024-02-22T19:05:54.321468+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: cephadm 2024-02-22T19:05:54.324742+0000 mgr.x (mgr.34862) 120 : cephadm [INF] Upgrade: Target is version 16.2.14-550-geb66ed92 (pacific) 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: cephadm 2024-02-22T19:05:54.325005+0000 mgr.x (mgr.34862) 121 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59, digests ['quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010'] 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: audit 2024-02-22T19:05:54.325660+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: audit 2024-02-22T19:05:54.332462+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: cephadm 2024-02-22T19:05:54.337167+0000 mgr.x (mgr.34862) 122 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: cephadm 2024-02-22T19:05:54.338621+0000 mgr.x (mgr.34862) 123 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: audit 2024-02-22T19:05:54.341081+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: cephadm 2024-02-22T19:05:54.342967+0000 mgr.x (mgr.34862) 124 : cephadm [INF] Failing over to other MGR 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: cluster 2024-02-22T19:05:54.347724+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: audit 2024-02-22T19:05:54.351863+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: audit 2024-02-22T19:05:54.353202+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:05:55.602 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:55 smithi040 bash[17964]: cluster 2024-02-22T19:05:55.157636+0000 mgr.x (mgr.34862) 125 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[27054]: debug 2024-02-22T19:05:55.337+0000 7f9a6bd1d700 -1 mgr handle_mgr_map I was active but no longer am 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[27054]: ignoring --setuser ceph since I am not root 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[27054]: ignoring --setgroup ceph since I am not root 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[27054]: debug 2024-02-22T19:05:55.389+0000 7fdd5301a700 1 -- 172.21.15.111:0/2287524476 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5610e9e7c4e0 con 0x5610e9f70800 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[27054]: debug 2024-02-22T19:05:55.545+0000 7fdd631f7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: audit 2024-02-22T19:05:54.321468+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: cephadm 2024-02-22T19:05:54.324742+0000 mgr.x (mgr.34862) 120 : cephadm [INF] Upgrade: Target is version 16.2.14-550-geb66ed92 (pacific) 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: cephadm 2024-02-22T19:05:54.325005+0000 mgr.x (mgr.34862) 121 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59, digests ['quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010'] 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: audit 2024-02-22T19:05:54.325660+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:05:55.653 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: audit 2024-02-22T19:05:54.332462+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' 2024-02-22T19:05:55.654 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: cephadm 2024-02-22T19:05:54.337167+0000 mgr.x (mgr.34862) 122 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:05:55.654 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: cephadm 2024-02-22T19:05:54.338621+0000 mgr.x (mgr.34862) 123 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:05:55.654 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: audit 2024-02-22T19:05:54.341081+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-22T19:05:55.654 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: cephadm 2024-02-22T19:05:54.342967+0000 mgr.x (mgr.34862) 124 : cephadm [INF] Failing over to other MGR 2024-02-22T19:05:55.654 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: cluster 2024-02-22T19:05:54.347724+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-22T19:05:55.654 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: audit 2024-02-22T19:05:54.351863+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:05:55.654 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: audit 2024-02-22T19:05:54.353202+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:05:55.654 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[14162]: cluster 2024-02-22T19:05:55.157636+0000 mgr.x (mgr.34862) 125 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 7.4 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:05:55.964 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:55 smithi111 bash[27054]: debug 2024-02-22T19:05:55.649+0000 7fdd631f7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T19:05:56.464 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:56 smithi111 bash[27054]: debug 2024-02-22T19:05:56.121+0000 7fdd631f7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T19:05:56.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:56 smithi111 bash[14162]: audit 2024-02-22T19:05:55.341066+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-22T19:05:56.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:56 smithi111 bash[14162]: cluster 2024-02-22T19:05:55.341193+0000 mon.a (mon.0) 1076 : cluster [DBG] mgrmap e30: y(active, starting, since 0.999401s) 2024-02-22T19:05:56.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:56 smithi111 bash[14162]: audit 2024-02-22T19:05:55.356176+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:05:56.464 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:05:56 smithi111 bash[14162]: cluster 2024-02-22T19:05:55.356382+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-22T19:05:56.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:56 smithi040 bash[13988]: audit 2024-02-22T19:05:55.341066+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-22T19:05:56.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:56 smithi040 bash[13988]: cluster 2024-02-22T19:05:55.341193+0000 mon.a (mon.0) 1076 : cluster [DBG] mgrmap e30: y(active, starting, since 0.999401s) 2024-02-22T19:05:56.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:56 smithi040 bash[13988]: audit 2024-02-22T19:05:55.356176+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:05:56.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:05:56 smithi040 bash[13988]: cluster 2024-02-22T19:05:55.356382+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-22T19:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:56 smithi040 bash[17964]: audit 2024-02-22T19:05:55.341066+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-22T19:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:56 smithi040 bash[17964]: cluster 2024-02-22T19:05:55.341193+0000 mon.a (mon.0) 1076 : cluster [DBG] mgrmap e30: y(active, starting, since 0.999401s) 2024-02-22T19:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:56 smithi040 bash[17964]: audit 2024-02-22T19:05:55.356176+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34862 172.21.15.111:0/4165764035' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:05:56.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:05:56 smithi040 bash[17964]: cluster 2024-02-22T19:05:55.356382+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-22T19:05:57.365 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:57 smithi111 bash[27054]: debug 2024-02-22T19:05:57.021+0000 7fdd631f7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T19:05:57.365 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:57 smithi111 bash[27054]: debug 2024-02-22T19:05:57.117+0000 7fdd631f7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T19:05:57.714 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:57 smithi111 bash[27054]: debug 2024-02-22T19:05:57.361+0000 7fdd631f7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T19:05:58.730 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:58 smithi111 bash[27054]: debug 2024-02-22T19:05:58.469+0000 7fdd631f7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T19:05:58.730 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:58 smithi111 bash[27054]: debug 2024-02-22T19:05:58.629+0000 7fdd631f7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:05:59.058 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:58 smithi111 bash[27054]: debug 2024-02-22T19:05:58.725+0000 7fdd631f7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T19:05:59.059 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:58 smithi111 bash[27054]: debug 2024-02-22T19:05:58.837+0000 7fdd631f7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T19:05:59.426 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:59 smithi111 bash[27054]: debug 2024-02-22T19:05:59.053+0000 7fdd631f7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T19:05:59.714 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:59 smithi111 bash[27054]: debug 2024-02-22T19:05:59.421+0000 7fdd631f7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T19:05:59.714 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:05:59 smithi111 bash[27054]: debug 2024-02-22T19:05:59.541+0000 7fdd631f7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T19:06:00.714 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:00 smithi111 bash[27054]: debug 2024-02-22T19:06:00.393+0000 7fdd631f7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T19:06:00.715 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:00 smithi111 bash[27054]: debug 2024-02-22T19:06:00.493+0000 7fdd631f7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T19:06:00.715 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:00 smithi111 bash[27054]: debug 2024-02-22T19:06:00.609+0000 7fdd631f7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T19:06:01.119 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:00 smithi111 bash[27054]: debug 2024-02-22T19:06:00.829+0000 7fdd631f7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T19:06:01.401 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[27054]: debug 2024-02-22T19:06:01.113+0000 7fdd631f7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T19:06:01.401 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[27054]: debug 2024-02-22T19:06:01.277+0000 7fdd631f7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T19:06:01.461 INFO:teuthology.orchestra.run.smithi040.stderr:Error ENOTSUP: Warning: due to ceph-mgr restart, some PG states may not be up to date 2024-02-22T19:06:01.461 INFO:teuthology.orchestra.run.smithi040.stderr:Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2024-02-22T19:06:01.651 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[39752]: debug 2024-02-22T19:06:01.452+0000 7f7fb5d5a700 -1 mgr.server reply reply (95) Operation not supported Warning: due to ceph-mgr restart, some PG states may not be up to date 2024-02-22T19:06:01.651 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[39752]: Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2024-02-22T19:06:01.651 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[39752]: Warning: Permanently added '172.21.15.111' (ECDSA) to the list of known hosts. 2024-02-22T19:06:01.651 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[39752]: Warning: Permanently added '172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.344579+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.344949+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.345258+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.347118+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.347626+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.348122+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.348609+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.349089+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.349409+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.349785+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:01.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.350137+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:06:01.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.350510+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:06:01.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.350889+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:06:01.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.351219+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:06:01.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.351989+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:06:01.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.354952+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:06:01.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.356706+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/client_keyrings"}]: dispatch 2024-02-22T19:06:01.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.357516+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:06:01.653 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.344579+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:06:01.653 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.344949+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.345258+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.347118+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.347626+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.348122+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.348609+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.349089+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.349409+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.349785+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.350137+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.350510+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.350889+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:06:01.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.351219+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:06:01.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.351989+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:06:01.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.354952+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:06:01.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.356706+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/client_keyrings"}]: dispatch 2024-02-22T19:06:01.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.357516+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:06:01.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.358285+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:06:01.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.358799+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.359327+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.359967+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.360514+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.361066+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.361536+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.361988+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.362406+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.362850+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.363307+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.363829+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.364345+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.364883+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:06:01.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.365445+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.365915+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.366460+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.367018+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.367689+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.368342+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.368934+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.369558+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.370135+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.370735+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: audit 2024-02-22T19:06:01.371363+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:06:01.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[13988]: cluster 2024-02-22T19:06:01.389888+0000 mon.a (mon.0) 1079 : cluster [INF] Manager daemon y is now available 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.358285+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.358799+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.359327+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.359967+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.360514+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.361066+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.361536+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.361988+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.362406+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.362850+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:06:01.658 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.363307+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.363829+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.364345+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.364883+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.365445+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.365915+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.366460+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.367018+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.367689+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.368342+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.368934+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:06:01.659 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.369558+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:06:01.660 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.370135+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:06:01.660 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.370735+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:06:01.660 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: audit 2024-02-22T19:06:01.371363+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:06:01.660 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[17964]: cluster 2024-02-22T19:06:01.389888+0000 mon.a (mon.0) 1079 : cluster [INF] Manager daemon y is now available 2024-02-22T19:06:01.660 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[27054]: debug 2024-02-22T19:06:01.449+0000 7fdd631f7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:06:01.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.344579+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:06:01.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.344949+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:06:01.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.345258+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:06:01.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.347118+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:06:01.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.347626+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.348122+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.348609+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.349089+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.349409+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.349785+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.350137+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.350510+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.350889+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.351219+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.351989+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.354952+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.356706+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/client_keyrings"}]: dispatch 2024-02-22T19:06:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.357516+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.358285+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.358799+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.359327+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.359967+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi111"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.360514+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.361066+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.361536+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.361988+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.362406+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.iscsi.iscsi"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.362850+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.363307+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:06:01.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.363829+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.364345+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.364883+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.365445+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.365915+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.366460+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.367018+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/_iscsi_config"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.367689+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.368342+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.368934+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.369558+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.370135+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:06:01.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.370735+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:06:01.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: audit 2024-02-22T19:06:01.371363+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:06:01.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[14162]: cluster 2024-02-22T19:06:01.389888+0000 mon.a (mon.0) 1079 : cluster [INF] Manager daemon y is now available 2024-02-22T19:06:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:01.651Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T19:06:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:01.651Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:06:01.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:01 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:01.651Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:06:01.964 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[27054]: debug 2024-02-22T19:06:01.665+0000 7fdd631f7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T19:06:01.964 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:01 smithi111 bash[27054]: debug 2024-02-22T19:06:01.773+0000 7fdd631f7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T19:06:02.401 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-22T19:06:02.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.454063+0000 mgr.y (mgr.15117) 1 : audit [DBG] from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:02.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: cluster 2024-02-22T19:06:01.454102+0000 mon.a (mon.0) 1080 : cluster [DBG] mgrmap e31: y(active, since 7s) 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: cluster 2024-02-22T19:06:01.459819+0000 mgr.y (mgr.15117) 2 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.555250+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.630223+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.631928+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.643085+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.644893+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: cluster 2024-02-22T19:06:01.793728+0000 mon.a (mon.0) 1083 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.797362+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.799898+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.801524+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.802194+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.886735+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:06:02.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[13988]: audit 2024-02-22T19:06:01.887057+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.454063+0000 mgr.y (mgr.15117) 1 : audit [DBG] from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: cluster 2024-02-22T19:06:01.454102+0000 mon.a (mon.0) 1080 : cluster [DBG] mgrmap e31: y(active, since 7s) 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: cluster 2024-02-22T19:06:01.459819+0000 mgr.y (mgr.15117) 2 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.555250+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.630223+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.631928+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.643085+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.644893+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: cluster 2024-02-22T19:06:01.793728+0000 mon.a (mon.0) 1083 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.797362+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.799898+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.801524+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.802194+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.886735+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:06:02.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:02 smithi040 bash[17964]: audit 2024-02-22T19:06:01.887057+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:06:02.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.454063+0000 mgr.y (mgr.15117) 1 : audit [DBG] from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:02.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: cluster 2024-02-22T19:06:01.454102+0000 mon.a (mon.0) 1080 : cluster [DBG] mgrmap e31: y(active, since 7s) 2024-02-22T19:06:02.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: cluster 2024-02-22T19:06:01.459819+0000 mgr.y (mgr.15117) 2 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:02.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.555250+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:06:02.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.630223+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:06:02.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.631928+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:06:02.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.643085+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:06:02.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.644893+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:06:02.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: cluster 2024-02-22T19:06:01.793728+0000 mon.a (mon.0) 1083 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:06:02.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.797362+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:06:02.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.799898+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:06:02.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.801524+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:06:02.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.802194+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.? 172.21.15.111:0/441939059' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:06:02.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.886735+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:06:02.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:02 smithi111 bash[14162]: audit 2024-02-22T19:06:01.887057+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:06:03.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:03 smithi111 bash[14162]: cluster 2024-02-22T19:06:02.444435+0000 mon.a (mon.0) 1084 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-02-22T19:06:03.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:03 smithi111 bash[14162]: cluster 2024-02-22T19:06:02.444509+0000 mon.a (mon.0) 1085 : cluster [INF] Cluster is now healthy 2024-02-22T19:06:03.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:03 smithi111 bash[14162]: cluster 2024-02-22T19:06:02.465260+0000 mon.a (mon.0) 1086 : cluster [DBG] mgrmap e32: y(active, since 8s), standbys: x 2024-02-22T19:06:03.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:03 smithi111 bash[14162]: audit 2024-02-22T19:06:02.470169+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:06:03.747 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:03 smithi040 bash[17964]: cluster 2024-02-22T19:06:02.444435+0000 mon.a (mon.0) 1084 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-02-22T19:06:03.747 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:03 smithi040 bash[17964]: cluster 2024-02-22T19:06:02.444509+0000 mon.a (mon.0) 1085 : cluster [INF] Cluster is now healthy 2024-02-22T19:06:03.747 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:03 smithi040 bash[17964]: cluster 2024-02-22T19:06:02.465260+0000 mon.a (mon.0) 1086 : cluster [DBG] mgrmap e32: y(active, since 8s), standbys: x 2024-02-22T19:06:03.747 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:03 smithi040 bash[17964]: audit 2024-02-22T19:06:02.470169+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:06:03.748 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:03 smithi040 bash[13988]: cluster 2024-02-22T19:06:02.444435+0000 mon.a (mon.0) 1084 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-02-22T19:06:03.748 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:03 smithi040 bash[13988]: cluster 2024-02-22T19:06:02.444509+0000 mon.a (mon.0) 1085 : cluster [INF] Cluster is now healthy 2024-02-22T19:06:03.748 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:03 smithi040 bash[13988]: cluster 2024-02-22T19:06:02.465260+0000 mon.a (mon.0) 1086 : cluster [DBG] mgrmap e32: y(active, since 8s), standbys: x 2024-02-22T19:06:03.748 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:03 smithi040 bash[13988]: audit 2024-02-22T19:06:02.470169+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:06:04.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:04 smithi040 bash[13988]: cluster 2024-02-22T19:06:03.348777+0000 mgr.y (mgr.15117) 3 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:04.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:04 smithi040 bash[13988]: cluster 2024-02-22T19:06:03.471951+0000 mon.a (mon.0) 1087 : cluster [DBG] mgrmap e33: y(active, since 9s), standbys: x 2024-02-22T19:06:04.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:04 smithi040 bash[17964]: cluster 2024-02-22T19:06:03.348777+0000 mgr.y (mgr.15117) 3 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:04.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:04 smithi040 bash[17964]: cluster 2024-02-22T19:06:03.471951+0000 mon.a (mon.0) 1087 : cluster [DBG] mgrmap e33: y(active, since 9s), standbys: x 2024-02-22T19:06:04.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:04 smithi111 bash[14162]: cluster 2024-02-22T19:06:03.348777+0000 mgr.y (mgr.15117) 3 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:04.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:04 smithi111 bash[14162]: cluster 2024-02-22T19:06:03.471951+0000 mon.a (mon.0) 1087 : cluster [DBG] mgrmap e33: y(active, since 9s), standbys: x 2024-02-22T19:06:05.722 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-22T19:06:06.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-22T19:06:06.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:06 smithi040 bash[13988]: cluster 2024-02-22T19:06:05.349526+0000 mgr.y (mgr.15117) 4 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:06.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:06 smithi040 bash[13988]: audit 2024-02-22T19:06:05.704345+0000 mon.a (mon.0) 1088 : audit [DBG] from='client.? 172.21.15.40:0/1529660990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:06:06.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:06 smithi040 bash[17964]: cluster 2024-02-22T19:06:05.349526+0000 mgr.y (mgr.15117) 4 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:06.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:06 smithi040 bash[17964]: audit 2024-02-22T19:06:05.704345+0000 mon.a (mon.0) 1088 : audit [DBG] from='client.? 172.21.15.40:0/1529660990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:06:06.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:06 smithi111 bash[14162]: cluster 2024-02-22T19:06:05.349526+0000 mgr.y (mgr.15117) 4 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:06.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:06 smithi111 bash[14162]: audit 2024-02-22T19:06:05.704345+0000 mon.a (mon.0) 1088 : audit [DBG] from='client.? 172.21.15.40:0/1529660990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:06:08.513 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:08 smithi040 bash[17964]: cluster 2024-02-22T19:06:07.350794+0000 mgr.y (mgr.15117) 5 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:08.513 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:08 smithi040 bash[13988]: cluster 2024-02-22T19:06:07.350794+0000 mgr.y (mgr.15117) 5 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:08.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:08 smithi111 bash[14162]: cluster 2024-02-22T19:06:07.350794+0000 mgr.y (mgr.15117) 5 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.398672+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.658947+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.661071+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.664619+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.665611+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.666497+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.667384+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.671910+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.674743+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.675689+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.676450+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.929363+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.930364+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.931274+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.932308+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.933232+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.398672+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.658947+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.661071+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.664619+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.665611+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.666497+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.667384+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.671910+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.674743+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.675689+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.676450+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.929363+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.930364+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.931274+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.932308+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.933232+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.934139+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.935021+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.935982+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.936925+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.938038+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.939981+0000 mon.b (mon.2) 129 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.950590+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.964302+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:06:09.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.965940+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.984438+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[17964]: audit 2024-02-22T19:06:08.985989+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.934139+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.935021+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.935982+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.936925+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.938038+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.939981+0000 mon.b (mon.2) 129 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.950590+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.964302+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.965940+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:06:09.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.984438+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:09.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:09 smithi040 bash[13988]: audit 2024-02-22T19:06:08.985989+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T19:06:09.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.398672+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:09.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.658947+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:09.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.661071+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.664619+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.665611+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.666497+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.667384+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.671910+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.674743+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.675689+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.676450+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.929363+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.930364+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.931274+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.932308+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.933232+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.934139+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.935021+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.935982+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:09.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.936925+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:06:09.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.938038+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:09.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.939981+0000 mon.b (mon.2) 129 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T19:06:09.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.950590+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:09.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.964302+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:06:09.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.965940+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:06:09.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.984438+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:09.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:09 smithi111 bash[14162]: audit 2024-02-22T19:06:08.985989+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.iscsi.iscsi.a","key": "container_image"}]: dispatch 2024-02-22T19:06:09.875 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)" 2024-02-22T19:06:10.666 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[17964]: cephadm 2024-02-22T19:06:08.939167+0000 mgr.y (mgr.15117) 6 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:06:10.666 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[17964]: cluster 2024-02-22T19:06:08.940611+0000 mgr.y (mgr.15117) 7 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:10.666 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[17964]: cephadm 2024-02-22T19:06:08.962872+0000 mgr.y (mgr.15117) 8 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T19:06:10.667 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[17964]: cephadm 2024-02-22T19:06:08.983106+0000 mgr.y (mgr.15117) 9 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T19:06:10.667 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[17964]: cluster 2024-02-22T19:06:09.654402+0000 mon.a (mon.0) 1093 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T19:06:10.667 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[17964]: audit 2024-02-22T19:06:09.857676+0000 mon.a (mon.0) 1094 : audit [DBG] from='client.? 172.21.15.40:0/457742598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:06:10.667 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[13988]: cephadm 2024-02-22T19:06:08.939167+0000 mgr.y (mgr.15117) 6 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:06:10.667 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[13988]: cluster 2024-02-22T19:06:08.940611+0000 mgr.y (mgr.15117) 7 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:10.667 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[13988]: cephadm 2024-02-22T19:06:08.962872+0000 mgr.y (mgr.15117) 8 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T19:06:10.667 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[13988]: cephadm 2024-02-22T19:06:08.983106+0000 mgr.y (mgr.15117) 9 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T19:06:10.667 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[13988]: cluster 2024-02-22T19:06:09.654402+0000 mon.a (mon.0) 1093 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T19:06:10.668 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:10 smithi040 bash[13988]: audit 2024-02-22T19:06:09.857676+0000 mon.a (mon.0) 1094 : audit [DBG] from='client.? 172.21.15.40:0/457742598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:06:10.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-22T19:06:10.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:10 smithi111 bash[14162]: cephadm 2024-02-22T19:06:08.939167+0000 mgr.y (mgr.15117) 6 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-22T19:06:10.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:10 smithi111 bash[14162]: cluster 2024-02-22T19:06:08.940611+0000 mgr.y (mgr.15117) 7 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:10.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:10 smithi111 bash[14162]: cephadm 2024-02-22T19:06:08.962872+0000 mgr.y (mgr.15117) 8 : cephadm [INF] Reconfiguring iscsi.iscsi.a (dependencies changed)... 2024-02-22T19:06:10.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:10 smithi111 bash[14162]: cephadm 2024-02-22T19:06:08.983106+0000 mgr.y (mgr.15117) 9 : cephadm [INF] Reconfiguring daemon iscsi.iscsi.a on smithi111 2024-02-22T19:06:10.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:10 smithi111 bash[14162]: cluster 2024-02-22T19:06:09.654402+0000 mon.a (mon.0) 1093 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T19:06:10.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:10 smithi111 bash[14162]: audit 2024-02-22T19:06:09.857676+0000 mon.a (mon.0) 1094 : audit [DBG] from='client.? 172.21.15.40:0/457742598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:06:11.824 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:11 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:06:11.916 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:11.651Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:06:11.916 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:11.651Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:06:11.916 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:11 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:11.652Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" 2024-02-22T19:06:12.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[13988]: cluster 2024-02-22T19:06:10.941381+0000 mgr.y (mgr.15117) 10 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:12.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[13988]: audit 2024-02-22T19:06:11.463645+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:12.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[13988]: audit 2024-02-22T19:06:11.475092+0000 mgr.y (mgr.15117) 11 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:06:12.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[13988]: audit 2024-02-22T19:06:11.476243+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:06:12.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[13988]: audit 2024-02-22T19:06:11.483585+0000 mgr.y (mgr.15117) 12 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:06:12.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[13988]: audit 2024-02-22T19:06:11.485146+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:06:12.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[13988]: audit 2024-02-22T19:06:11.491013+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:06:12.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[17964]: cluster 2024-02-22T19:06:10.941381+0000 mgr.y (mgr.15117) 10 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:12.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[17964]: audit 2024-02-22T19:06:11.463645+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:12.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[17964]: audit 2024-02-22T19:06:11.475092+0000 mgr.y (mgr.15117) 11 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:06:12.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[17964]: audit 2024-02-22T19:06:11.476243+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:06:12.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[17964]: audit 2024-02-22T19:06:11.483585+0000 mgr.y (mgr.15117) 12 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:06:12.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[17964]: audit 2024-02-22T19:06:11.485146+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:06:12.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:12 smithi040 bash[17964]: audit 2024-02-22T19:06:11.491013+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:06:12.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:12 smithi111 bash[14162]: cluster 2024-02-22T19:06:10.941381+0000 mgr.y (mgr.15117) 10 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:12.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:12 smithi111 bash[14162]: audit 2024-02-22T19:06:11.463645+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.15117 ' entity='mgr.y' 2024-02-22T19:06:12.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:12 smithi111 bash[14162]: audit 2024-02-22T19:06:11.475092+0000 mgr.y (mgr.15117) 11 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:06:12.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:12 smithi111 bash[14162]: audit 2024-02-22T19:06:11.476243+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-22T19:06:12.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:12 smithi111 bash[14162]: audit 2024-02-22T19:06:11.483585+0000 mgr.y (mgr.15117) 12 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:06:12.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:12 smithi111 bash[14162]: audit 2024-02-22T19:06:11.485146+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-22T19:06:12.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:12 smithi111 bash[14162]: audit 2024-02-22T19:06:11.491013+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:06:13.524 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:13 smithi111 bash[37720]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T19:06:14.011 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-22T19:06:14.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-22T19:06:14.735 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[14162]: cluster 2024-02-22T19:06:12.942947+0000 mgr.y (mgr.15117) 13 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:14.735 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[14162]: audit 2024-02-22T19:06:13.994535+0000 mon.c (mon.1) 138 : audit [DBG] from='client.? 172.21.15.40:0/630300880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:06:14.735 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[14162]: audit 2024-02-22T19:06:14.141126+0000 mon.b (mon.2) 136 : audit [DBG] from='client.? 172.21.15.111:0/2957988033' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:06:14.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: --- Logging error --- 2024-02-22T19:06:14.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.send(msg) 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: During handling of the above exception, another exception occurred: 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.connect(address) 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: During handling of the above exception, another exception occurred: 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self._connect_unixsocket(self.address) 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:06:14.736 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.connect(address) 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Call stack: 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self._bootstrap_inner() 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.run() 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/bin/rbd-target-api", line 2784, in run 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: logger.info("Started the configuration object watcher") 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Message: 'Started the configuration object watcher' 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Arguments: () 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: --- Logging error --- 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.send(msg) 2024-02-22T19:06:14.737 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: During handling of the above exception, another exception occurred: 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.connect(address) 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: During handling of the above exception, another exception occurred: 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self._connect_unixsocket(self.address) 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.connect(address) 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Call stack: 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: main() 2024-02-22T19:06:14.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 66, in osd_blacklist_cleanup 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.logger.info("Processing osd blacklist entries for this node") 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Message: 'Processing osd blacklist entries for this node' 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Arguments: () 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: --- Logging error --- 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.send(msg) 2024-02-22T19:06:14.739 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: During handling of the above exception, another exception occurred: 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.connect(address) 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: During handling of the above exception, another exception occurred: 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self._connect_unixsocket(self.address) 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.connect(address) 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Call stack: 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/threading.py", line 884, in _bootstrap 2024-02-22T19:06:14.740 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self._bootstrap_inner() 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.run() 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/bin/rbd-target-api", line 2786, in run 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.interval)) 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Message: 'Checking for config object changes every 1s' 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Arguments: () 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: --- Logging error --- 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 936, in emit 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.send(msg) 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: OSError: [Errno 9] Bad file descriptor 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: During handling of the above exception, another exception occurred: 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 857, in _connect_unixsocket 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.connect(address) 2024-02-22T19:06:14.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: During handling of the above exception, another exception occurred: 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 939, in emit 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self._connect_unixsocket(self.address) 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/logging/handlers.py", line 868, in _connect_unixsocket 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: self.socket.connect(address) 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: FileNotFoundError: [Errno 2] No such file or directory 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Call stack: 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: main() 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:06:14.742 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 37, in ceph_rm_blacklist 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: "{}".format(blacklisted_ip)) 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Message: 'Removing blacklisted entry for this host : 172.21.15.111:0/3116463761' 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Arguments: () 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: Traceback (most recent call last): 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/bin/rbd-target-api", line 2951, in 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: main() 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/bin/rbd-target-api", line 2861, in main 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: osd_state_ok = ceph_gw.osd_blacklist_cleanup() 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 110, in osd_blacklist_cleanup 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: rm_ok = self.ceph_rm_blacklist(blacklist_entry.split(' ')[0]) 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib/python3.6/site-packages/ceph_iscsi_config/gateway.py", line 45, in ceph_rm_blacklist 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: stderr=subprocess.STDOUT, shell=True) 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/subprocess.py", line 356, in check_output 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: **kwargs).stdout 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: File "/usr/lib64/python3.6/subprocess.py", line 438, in run 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: output=stdout, stderr=stderr) 2024-02-22T19:06:14.743 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:14 smithi111 bash[37736]: subprocess.CalledProcessError: Command 'ceph -n client.iscsi.iscsi.a --conf /etc/ceph/ceph.conf osd blacklist rm 172.21.15.111:0/3116463761' returned non-zero exit status 13. 2024-02-22T19:06:14.856 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:14 smithi040 bash[17964]: cluster 2024-02-22T19:06:12.942947+0000 mgr.y (mgr.15117) 13 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:14.856 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:14 smithi040 bash[17964]: audit 2024-02-22T19:06:13.994535+0000 mon.c (mon.1) 138 : audit [DBG] from='client.? 172.21.15.40:0/630300880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:06:14.856 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:14 smithi040 bash[17964]: audit 2024-02-22T19:06:14.141126+0000 mon.b (mon.2) 136 : audit [DBG] from='client.? 172.21.15.111:0/2957988033' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:06:14.856 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:14 smithi040 bash[13988]: cluster 2024-02-22T19:06:12.942947+0000 mgr.y (mgr.15117) 13 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:14.856 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:14 smithi040 bash[13988]: audit 2024-02-22T19:06:13.994535+0000 mon.c (mon.1) 138 : audit [DBG] from='client.? 172.21.15.40:0/630300880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:06:14.856 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:14 smithi040 bash[13988]: audit 2024-02-22T19:06:14.141126+0000 mon.b (mon.2) 136 : audit [DBG] from='client.? 172.21.15.111:0/2957988033' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist ls"}]: dispatch 2024-02-22T19:06:15.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:15 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:06:15.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:15 smithi111 bash[37720]: (process:1): GLib-GObject-CRITICAL **: 19:06:15.556: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T19:06:15.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:15 smithi111 bash[14162]: audit 2024-02-22T19:06:14.470841+0000 mon.b (mon.2) 137 : audit [INF] from='client.? 172.21.15.111:0/756951689' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:06:15.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:15 smithi111 bash[14162]: cephadm 2024-02-22T19:06:14.515806+0000 mgr.y (mgr.15117) 14 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-22T19:06:15.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:15 smithi111 bash[14162]: audit 2024-02-22T19:06:14.517664+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:06:15.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:15 smithi111 bash[14162]: audit 2024-02-22T19:06:14.519102+0000 mon.b (mon.2) 138 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:06:15.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:15 smithi111 bash[14162]: audit 2024-02-22T19:06:14.522481+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:06:15.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:15 smithi111 bash[14162]: cephadm 2024-02-22T19:06:14.523428+0000 mgr.y (mgr.15117) 15 : cephadm [INF] Deploying daemon mgr.x on smithi111 2024-02-22T19:06:15.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:15 smithi111 bash[14162]: audit 2024-02-22T19:06:14.524281+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:15.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:15 smithi111 bash[14162]: audit 2024-02-22T19:06:14.526759+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-22T19:06:15.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[13988]: audit 2024-02-22T19:06:14.470841+0000 mon.b (mon.2) 137 : audit [INF] from='client.? 172.21.15.111:0/756951689' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:06:15.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[13988]: cephadm 2024-02-22T19:06:14.515806+0000 mgr.y (mgr.15117) 14 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-22T19:06:15.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[13988]: audit 2024-02-22T19:06:14.517664+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:06:15.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[13988]: audit 2024-02-22T19:06:14.519102+0000 mon.b (mon.2) 138 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:06:15.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[13988]: audit 2024-02-22T19:06:14.522481+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:06:15.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[13988]: cephadm 2024-02-22T19:06:14.523428+0000 mgr.y (mgr.15117) 15 : cephadm [INF] Deploying daemon mgr.x on smithi111 2024-02-22T19:06:15.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[13988]: audit 2024-02-22T19:06:14.524281+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:15.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[13988]: audit 2024-02-22T19:06:14.526759+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-22T19:06:15.785 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[17964]: audit 2024-02-22T19:06:14.470841+0000 mon.b (mon.2) 137 : audit [INF] from='client.? 172.21.15.111:0/756951689' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.111:0/3116463761"}]: access denied 2024-02-22T19:06:15.785 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[17964]: cephadm 2024-02-22T19:06:14.515806+0000 mgr.y (mgr.15117) 14 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-22T19:06:15.785 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[17964]: audit 2024-02-22T19:06:14.517664+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.15117 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:06:15.785 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[17964]: audit 2024-02-22T19:06:14.519102+0000 mon.b (mon.2) 138 : audit [INF] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:06:15.785 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[17964]: audit 2024-02-22T19:06:14.522481+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:06:15.785 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[17964]: cephadm 2024-02-22T19:06:14.523428+0000 mgr.y (mgr.15117) 15 : cephadm [INF] Deploying daemon mgr.x on smithi111 2024-02-22T19:06:15.785 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[17964]: audit 2024-02-22T19:06:14.524281+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:15.785 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:15 smithi040 bash[17964]: audit 2024-02-22T19:06:14.526759+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-22T19:06:16.561 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:16 smithi111 bash[14162]: cluster 2024-02-22T19:06:14.943727+0000 mgr.y (mgr.15117) 16 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:16.562 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:16 smithi111 bash[38074]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T19:06:16.562 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:16 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:06:16.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:16 smithi040 bash[17964]: cluster 2024-02-22T19:06:14.943727+0000 mgr.y (mgr.15117) 16 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:16.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:16 smithi040 bash[13988]: cluster 2024-02-22T19:06:14.943727+0000 mgr.y (mgr.15117) 16 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:06:17.714 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:17 smithi111 systemd[1]: Stopping Ceph mgr.x for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:18.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:18 smithi040 bash[17964]: cluster 2024-02-22T19:06:16.945335+0000 mgr.y (mgr.15117) 17 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 88 B/s rd, 0 op/s 2024-02-22T19:06:18.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:18 smithi040 bash[13988]: cluster 2024-02-22T19:06:16.945335+0000 mgr.y (mgr.15117) 17 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 88 B/s rd, 0 op/s 2024-02-22T19:06:18.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:18 smithi111 bash[14162]: cluster 2024-02-22T19:06:16.945335+0000 mgr.y (mgr.15117) 17 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 88 B/s rd, 0 op/s 2024-02-22T19:06:19.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:19 smithi040 bash[13988]: audit 2024-02-22T19:06:17.997837+0000 mgr.y (mgr.15117) 18 : audit [DBG] from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:19.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:19 smithi040 bash[17964]: audit 2024-02-22T19:06:17.997837+0000 mgr.y (mgr.15117) 18 : audit [DBG] from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:19.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:19 smithi111 bash[14162]: audit 2024-02-22T19:06:17.997837+0000 mgr.y (mgr.15117) 18 : audit [DBG] from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-22T19:06:20.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:20 smithi040 bash[13988]: cluster 2024-02-22T19:06:18.946093+0000 mgr.y (mgr.15117) 19 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 88 B/s rd, 0 op/s 2024-02-22T19:06:20.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:20 smithi040 bash[17964]: cluster 2024-02-22T19:06:18.946093+0000 mgr.y (mgr.15117) 19 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 88 B/s rd, 0 op/s 2024-02-22T19:06:20.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '"'"'{print $2}'"'"')' 2024-02-22T19:06:20.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:20 smithi111 bash[14162]: cluster 2024-02-22T19:06:18.946093+0000 mgr.y (mgr.15117) 19 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 88 B/s rd, 0 op/s 2024-02-22T19:06:21.926 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:21.652Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com" context_err="context deadline exceeded" 2024-02-22T19:06:21.926 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:21.652Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" context_err="context deadline exceeded" 2024-02-22T19:06:21.926 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:21 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:21.652Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi040.front.sepia.ceph.com; Post https://smithi111:8443/api/prometheus_receiver: x509: certificate is valid for ceph-dashboard, not smithi111" 2024-02-22T19:06:22.761 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:22 smithi040 bash[13988]: cluster 2024-02-22T19:06:20.946860+0000 mgr.y (mgr.15117) 20 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:06:22.762 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:22 smithi040 bash[17964]: cluster 2024-02-22T19:06:20.946860+0000 mgr.y (mgr.15117) 20 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:06:22.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:22 smithi111 bash[14162]: cluster 2024-02-22T19:06:20.946860+0000 mgr.y (mgr.15117) 20 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:06:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:Error EINVAL: Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:24.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: debug 2024-02-22T19:06:24.407+0000 7f7fa5d3a700 -1 log_channel(cephadm) log [ERR] : Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:24.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: Traceback (most recent call last): 2024-02-22T19:06:24.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 125, in wrapper 2024-02-22T19:06:24.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: return OrchResult(f(*args, **kwargs)) 2024-02-22T19:06:24.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2909, in upgrade_start 2024-02-22T19:06:24.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: return self.upgrade.upgrade_start(image, version, daemon_types, hosts, services, limit) 2024-02-22T19:06:24.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 310, in upgrade_start 2024-02-22T19:06:24.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: self._validate_upgrade_filters(target_name, daemon_types, hosts, services) 2024-02-22T19:06:24.680 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 370, in _validate_upgrade_filters 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: raise OrchestratorError('Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress.') 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: orchestrator._interface.OrchestratorError: Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[39752]: debug 2024-02-22T19:06:24.407+0000 7f7fa5d3a700 -1 mgr.server reply reply (22) Invalid argument Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: cluster 2024-02-22T19:06:22.948642+0000 mgr.y (mgr.15117) 21 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.031861+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.032984+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.034018+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.034961+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.035877+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.036763+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.042382+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.043325+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.044207+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.045061+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[13988]: audit 2024-02-22T19:06:24.045892+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: cluster 2024-02-22T19:06:22.948642+0000 mgr.y (mgr.15117) 21 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.031861+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.032984+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.034018+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.034961+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.035877+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.036763+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.042382+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:06:24.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.043325+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.044207+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.045061+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:24 smithi040 bash[17964]: audit 2024-02-22T19:06:24.045892+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: cluster 2024-02-22T19:06:22.948642+0000 mgr.y (mgr.15117) 21 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 7.4 KiB data, 6.1 MiB used, 707 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-02-22T19:06:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.031861+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:06:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.032984+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:06:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.034018+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.034961+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.964 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.035877+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.036763+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.042382+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:06:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.043325+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.044207+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.045061+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:24.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:24 smithi111 bash[14162]: audit 2024-02-22T19:06:24.045892+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.15117 172.21.15.40:0/3442215525' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:06:25.182 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-22T19:06:25.183 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks/cephadm.py", line 1058, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks/cephadm.py", line 34, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c \'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk \'"\'"\'{print $2}\'"\'"\')\'' 2024-02-22T19:06:25.388 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ca3cd47f27794c52bd538165a2aeaeba Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks/cephadm.py", line 1058, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks/cephadm.py", line 34, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c \'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk \'"\'"\'{print $2}\'"\'"\')\'' 2024-02-22T19:06:25.390 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-22T19:06:25.400 INFO:tasks.cephadm:Teardown begin 2024-02-22T19:06:25.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:06:25.421 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:06:25.437 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-22T19:06:25.437 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-22T19:06:25.469 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-22T19:06:25.484 INFO:tasks.cephadm:Stopping all daemons... 2024-02-22T19:06:25.484 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-22T19:06:25.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a 2024-02-22T19:06:25.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: audit 2024-02-22T19:06:24.023387+0000 mgr.y (mgr.15117) 22 : audit [DBG] from='client.25255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:25.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: audit 2024-02-22T19:06:24.406859+0000 mgr.y (mgr.15117) 23 : audit [DBG] from='client.15336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "daemon_types": "mon", "hosts": "smithi111", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:25.714 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: cephadm 2024-02-22T19:06:24.410605+0000 mgr.y (mgr.15117) 24 : cephadm [ERR] Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:25.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: Traceback (most recent call last): 2024-02-22T19:06:25.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 125, in wrapper 2024-02-22T19:06:25.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: return OrchResult(f(*args, **kwargs)) 2024-02-22T19:06:25.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2909, in upgrade_start 2024-02-22T19:06:25.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: return self.upgrade.upgrade_start(image, version, daemon_types, hosts, services, limit) 2024-02-22T19:06:25.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 310, in upgrade_start 2024-02-22T19:06:25.715 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: self._validate_upgrade_filters(target_name, daemon_types, hosts, services) 2024-02-22T19:06:25.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 370, in _validate_upgrade_filters 2024-02-22T19:06:25.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: raise OrchestratorError('Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress.') 2024-02-22T19:06:25.716 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:25 smithi111 bash[14162]: orchestrator._interface.OrchestratorError: Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:25.895 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: audit 2024-02-22T19:06:24.023387+0000 mgr.y (mgr.15117) 22 : audit [DBG] from='client.25255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:25.895 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: audit 2024-02-22T19:06:24.406859+0000 mgr.y (mgr.15117) 23 : audit [DBG] from='client.15336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "daemon_types": "mon", "hosts": "smithi111", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:25.895 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: cephadm 2024-02-22T19:06:24.410605+0000 mgr.y (mgr.15117) 24 : cephadm [ERR] Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:25.895 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: Traceback (most recent call last): 2024-02-22T19:06:25.895 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 125, in wrapper 2024-02-22T19:06:25.896 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: return OrchResult(f(*args, **kwargs)) 2024-02-22T19:06:25.896 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2909, in upgrade_start 2024-02-22T19:06:25.896 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: return self.upgrade.upgrade_start(image, version, daemon_types, hosts, services, limit) 2024-02-22T19:06:25.896 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 310, in upgrade_start 2024-02-22T19:06:25.896 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: self._validate_upgrade_filters(target_name, daemon_types, hosts, services) 2024-02-22T19:06:25.897 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 370, in _validate_upgrade_filters 2024-02-22T19:06:25.897 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: raise OrchestratorError('Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress.') 2024-02-22T19:06:25.897 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[17964]: orchestrator._interface.OrchestratorError: Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:25.897 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 systemd[1]: Stopping Ceph mon.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:25.897 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: audit 2024-02-22T19:06:24.023387+0000 mgr.y (mgr.15117) 22 : audit [DBG] from='client.25255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:25.897 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: audit 2024-02-22T19:06:24.406859+0000 mgr.y (mgr.15117) 23 : audit [DBG] from='client.15336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "daemon_types": "mon", "hosts": "smithi111", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:25.898 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: cephadm 2024-02-22T19:06:24.410605+0000 mgr.y (mgr.15117) 24 : cephadm [ERR] Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:25.898 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: Traceback (most recent call last): 2024-02-22T19:06:25.898 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 125, in wrapper 2024-02-22T19:06:25.898 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: return OrchResult(f(*args, **kwargs)) 2024-02-22T19:06:25.898 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2909, in upgrade_start 2024-02-22T19:06:25.898 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: return self.upgrade.upgrade_start(image, version, daemon_types, hosts, services, limit) 2024-02-22T19:06:25.898 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 310, in upgrade_start 2024-02-22T19:06:25.898 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: self._validate_upgrade_filters(target_name, daemon_types, hosts, services) 2024-02-22T19:06:25.899 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 370, in _validate_upgrade_filters 2024-02-22T19:06:25.899 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: raise OrchestratorError('Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress.') 2024-02-22T19:06:25.899 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: orchestrator._interface.OrchestratorError: Cannot set values for --daemon-types, --services or --hosts when upgrade already in progress. 2024-02-22T19:06:25.899 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: debug 2024-02-22T19:06:25.623+0000 7fcb8591b700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:25.899 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 22 19:06:25 smithi040 bash[13988]: debug 2024-02-22T19:06:25.623+0000 7fcb8591b700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-22T19:06:26.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.a.service' 2024-02-22T19:06:26.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:26.580 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-22T19:06:26.580 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-02-22T19:06:26.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.c 2024-02-22T19:06:26.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:26 smithi040 systemd[1]: Stopping Ceph mon.c for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:26.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:26 smithi040 bash[17964]: debug 2024-02-22T19:06:26.759+0000 7f6ce14e3700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:26.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 22 19:06:26 smithi040 bash[17964]: debug 2024-02-22T19:06:26.759+0000 7f6ce14e3700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-02-22T19:06:26.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:26 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Scheduled restart job, restart counter is at 1. 2024-02-22T19:06:26.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:26 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:06:26.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:26 smithi111 systemd[1]: Started Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:06:27.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.c.service' 2024-02-22T19:06:27.658 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:27.658 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-02-22T19:06:27.658 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-02-22T19:06:27.658 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.b 2024-02-22T19:06:27.838 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:27 smithi111 systemd[1]: Stopping Ceph mon.b for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:28.127 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:27 smithi111 bash[14162]: debug 2024-02-22T19:06:27.833+0000 7fcaa6296700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:28.128 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:27 smithi111 bash[14162]: debug 2024-02-22T19:06:27.833+0000 7fcaa6296700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-02-22T19:06:29.178 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:06:28 smithi111 bash[38246]: log file path now is '/var/log/tcmu-runner.log' 2024-02-22T19:06:29.178 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:28 smithi111 bash[38206]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-mgr.x 2024-02-22T19:06:29.178 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:29 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-02-22T19:06:29.179 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:28 smithi111 bash[38281]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-mon.b 2024-02-22T19:06:29.179 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:28 smithi111 bash[38423]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/mon.b/unit.stop: No such file or directory 2024-02-22T19:06:29.179 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:29 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.b.service: Succeeded. 2024-02-22T19:06:29.179 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 22 19:06:29 smithi111 systemd[1]: Stopped Ceph mon.b for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:06:29.180 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mon.b.service' 2024-02-22T19:06:29.217 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:29.217 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-02-22T19:06:29.218 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-22T19:06:29.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y 2024-02-22T19:06:29.443 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:29 smithi111 bash[38452]: Error response from daemon: No such container: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-mgr.x 2024-02-22T19:06:29.443 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:29 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-02-22T19:06:29.443 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:29 smithi111 systemd[1]: Stopped Ceph mgr.x for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:06:29.628 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:29 smithi040 systemd[1]: Stopping Ceph mgr.y for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:29.628 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:29 smithi040 bash[46891]: Error response from daemon: No such container: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-mgr.y 2024-02-22T19:06:29.628 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:29 smithi040 bash[39752]: debug 2024-02-22T19:06:29.403+0000 7f8019796700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-22T19:06:29.628 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 22 19:06:29 smithi040 bash[39752]: debug 2024-02-22T19:06:29.403+0000 7f8019796700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-02-22T19:06:29.714 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:29 smithi111 systemd[1]: Started Ceph mgr.x for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:06:30.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.y.service' 2024-02-22T19:06:30.170 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:30.170 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-22T19:06:30.170 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-22T19:06:30.170 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.x 2024-02-22T19:06:30.464 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:30 smithi111 systemd[1]: Stopping Ceph mgr.x for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:30.464 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 22 19:06:30 smithi111 bash[38577]: Error response from daemon: No such container: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-mgr.x 2024-02-22T19:06:31.557 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@mgr.x.service' 2024-02-22T19:06:31.585 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:31.585 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-22T19:06:31.585 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-22T19:06:31.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.0 2024-02-22T19:06:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:31.652Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T19:06:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:31.652Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T19:06:31.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:31 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:31.652Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused" 2024-02-22T19:06:31.930 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 19:06:31 smithi040 systemd[1]: Stopping Ceph osd.0 for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:31.930 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 19:06:31 smithi040 bash[20705]: debug 2024-02-22T19:06:31.731+0000 7fba6881e700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:31.931 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 19:06:31 smithi040 bash[20705]: debug 2024-02-22T19:06:31.731+0000 7fba6881e700 -1 osd.0 69 *** Got signal Terminated *** 2024-02-22T19:06:31.931 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 19:06:31 smithi040 bash[20705]: debug 2024-02-22T19:06:31.731+0000 7fba6881e700 -1 osd.0 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:06:32.679 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 19:06:32 smithi040 bash[47004]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-osd.0 2024-02-22T19:06:32.680 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 22 19:06:32 smithi040 bash[47043]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/osd.0/unit.stop: No such file or directory 2024-02-22T19:06:34.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.0.service' 2024-02-22T19:06:34.591 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:34.591 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-22T19:06:34.591 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-22T19:06:34.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.1 2024-02-22T19:06:34.874 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 19:06:34 smithi040 systemd[1]: Stopping Ceph osd.1 for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:34.875 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 19:06:34 smithi040 bash[22240]: debug 2024-02-22T19:06:34.775+0000 7fbf39b48700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:34.875 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 19:06:34 smithi040 bash[22240]: debug 2024-02-22T19:06:34.775+0000 7fbf39b48700 -1 osd.1 69 *** Got signal Terminated *** 2024-02-22T19:06:34.875 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 19:06:34 smithi040 bash[22240]: debug 2024-02-22T19:06:34.775+0000 7fbf39b48700 -1 osd.1 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:06:35.680 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 19:06:35 smithi040 bash[47140]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-osd.1 2024-02-22T19:06:35.680 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 22 19:06:35 smithi040 bash[47175]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/osd.1/unit.stop: No such file or directory 2024-02-22T19:06:37.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.1.service' 2024-02-22T19:06:37.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:37.615 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-22T19:06:37.615 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-22T19:06:37.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.2 2024-02-22T19:06:37.832 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 19:06:37 smithi040 systemd[1]: Stopping Ceph osd.2 for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:37.832 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 19:06:37 smithi040 bash[24087]: debug 2024-02-22T19:06:37.747+0000 7f618d835700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:37.832 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 19:06:37 smithi040 bash[24087]: debug 2024-02-22T19:06:37.747+0000 7f618d835700 -1 osd.2 69 *** Got signal Terminated *** 2024-02-22T19:06:37.832 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 19:06:37 smithi040 bash[24087]: debug 2024-02-22T19:06:37.747+0000 7f618d835700 -1 osd.2 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:06:38.679 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 19:06:38 smithi040 bash[47274]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-osd.2 2024-02-22T19:06:38.680 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 22 19:06:38 smithi040 bash[47313]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/osd.2/unit.stop: No such file or directory 2024-02-22T19:06:40.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.2.service' 2024-02-22T19:06:40.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:40.631 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-22T19:06:40.631 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-22T19:06:40.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.3 2024-02-22T19:06:40.923 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 19:06:40 smithi040 systemd[1]: Stopping Ceph osd.3 for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:40.923 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 19:06:40 smithi040 bash[25592]: debug 2024-02-22T19:06:40.831+0000 7ff92fd21700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:40.923 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 19:06:40 smithi040 bash[25592]: debug 2024-02-22T19:06:40.831+0000 7ff92fd21700 -1 osd.3 69 *** Got signal Terminated *** 2024-02-22T19:06:40.923 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 19:06:40 smithi040 bash[25592]: debug 2024-02-22T19:06:40.831+0000 7ff92fd21700 -1 osd.3 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:06:41.930 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 19:06:41 smithi040 bash[47413]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-osd.3 2024-02-22T19:06:41.930 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 22 19:06:41 smithi040 bash[47452]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/osd.3/unit.stop: No such file or directory 2024-02-22T19:06:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:41.653Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T19:06:41.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:41.653Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T19:06:41.931 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:41 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:41.653Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused; Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused" 2024-02-22T19:06:43.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.3.service' 2024-02-22T19:06:43.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:43.633 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-22T19:06:43.633 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-22T19:06:43.633 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.4 2024-02-22T19:06:43.899 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 19:06:43 smithi111 systemd[1]: Stopping Ceph osd.4 for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:43.899 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 19:06:43 smithi111 bash[16437]: debug 2024-02-22T19:06:43.792+0000 7f11a1205700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:43.899 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 19:06:43 smithi111 bash[16437]: debug 2024-02-22T19:06:43.792+0000 7f11a1205700 -1 osd.4 69 *** Got signal Terminated *** 2024-02-22T19:06:43.899 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 19:06:43 smithi111 bash[16437]: debug 2024-02-22T19:06:43.792+0000 7f11a1205700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:06:44.718 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 19:06:44 smithi111 bash[38761]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-osd.4 2024-02-22T19:06:44.719 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 22 19:06:44 smithi111 bash[38808]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/osd.4/unit.stop: No such file or directory 2024-02-22T19:06:46.550 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.4.service' 2024-02-22T19:06:46.585 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:46.586 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-22T19:06:46.586 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-22T19:06:46.586 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.5 2024-02-22T19:06:46.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 19:06:46 smithi111 systemd[1]: Stopping Ceph osd.5 for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:46.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 19:06:46 smithi111 bash[18181]: debug 2024-02-22T19:06:46.716+0000 7fed70e00700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:46.965 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 19:06:46 smithi111 bash[18181]: debug 2024-02-22T19:06:46.716+0000 7fed70e00700 -1 osd.5 69 *** Got signal Terminated *** 2024-02-22T19:06:46.965 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 19:06:46 smithi111 bash[18181]: debug 2024-02-22T19:06:46.716+0000 7fed70e00700 -1 osd.5 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:06:47.714 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 19:06:47 smithi111 bash[38908]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-osd.5 2024-02-22T19:06:47.714 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 22 19:06:47 smithi111 bash[38946]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/osd.5/unit.stop: No such file or directory 2024-02-22T19:06:49.348 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.5.service' 2024-02-22T19:06:49.380 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:49.380 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-22T19:06:49.380 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-22T19:06:49.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.6 2024-02-22T19:06:49.604 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 19:06:49 smithi111 systemd[1]: Stopping Ceph osd.6 for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:49.604 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 19:06:49 smithi111 bash[19646]: debug 2024-02-22T19:06:49.476+0000 7ff8ddc31700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:49.604 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 19:06:49 smithi111 bash[19646]: debug 2024-02-22T19:06:49.476+0000 7ff8ddc31700 -1 osd.6 69 *** Got signal Terminated *** 2024-02-22T19:06:49.604 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 19:06:49 smithi111 bash[19646]: debug 2024-02-22T19:06:49.476+0000 7ff8ddc31700 -1 osd.6 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:06:50.464 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 19:06:50 smithi111 bash[39042]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-osd.6 2024-02-22T19:06:50.464 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 22 19:06:50 smithi111 bash[39078]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/osd.6/unit.stop: No such file or directory 2024-02-22T19:06:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:51.653Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T19:06:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:51.653Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused" context_err="context deadline exceeded" 2024-02-22T19:06:51.930 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:06:51 smithi040 bash[29235]: level=error ts=2024-02-22T19:06:51.653Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://smithi040.front.sepia.ceph.com:8443/api/prometheus_receiver: dial tcp 172.21.15.40:8443: connect: connection refused; Post https://smithi111:8443/api/prometheus_receiver: dial tcp 172.21.15.111:8443: connect: connection refused" 2024-02-22T19:06:52.070 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.6.service' 2024-02-22T19:06:52.105 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:52.106 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-22T19:06:52.106 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-22T19:06:52.106 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.7 2024-02-22T19:06:52.325 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 19:06:52 smithi111 systemd[1]: Stopping Ceph osd.7 for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:52.325 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 19:06:52 smithi111 bash[21373]: debug 2024-02-22T19:06:52.248+0000 7f6e6c1ce700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:06:52.325 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 19:06:52 smithi111 bash[21373]: debug 2024-02-22T19:06:52.248+0000 7f6e6c1ce700 -1 osd.7 69 *** Got signal Terminated *** 2024-02-22T19:06:52.326 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 19:06:52 smithi111 bash[21373]: debug 2024-02-22T19:06:52.248+0000 7f6e6c1ce700 -1 osd.7 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:06:53.214 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 19:06:52 smithi111 bash[39171]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-osd.7 2024-02-22T19:06:53.214 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 22 19:06:52 smithi111 bash[39209]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/osd.7/unit.stop: No such file or directory 2024-02-22T19:06:54.724 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@osd.7.service' 2024-02-22T19:06:54.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:54.758 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-22T19:06:54.758 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-02-22T19:06:54.758 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@prometheus.a 2024-02-22T19:06:54.994 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 systemd[1]: Stopping Ceph prometheus.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:06:54.994 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=warn ts=2024-02-22T19:06:54.846Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2024-02-22T19:06:54.994 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.846Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2024-02-22T19:06:54.994 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.846Z caller=main.go:561 msg="Stopping notify discovery manager..." 2024-02-22T19:06:54.995 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.846Z caller=main.go:583 msg="Stopping scrape manager..." 2024-02-22T19:06:54.995 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.846Z caller=main.go:543 msg="Scrape discovery manager stopped" 2024-02-22T19:06:54.995 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.846Z caller=main.go:557 msg="Notify discovery manager stopped" 2024-02-22T19:06:54.995 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.846Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2024-02-22T19:06:54.995 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.847Z caller=main.go:577 msg="Scrape manager stopped" 2024-02-22T19:06:54.995 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.847Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2024-02-22T19:06:54.995 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.847Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2024-02-22T19:06:54.995 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.847Z caller=main.go:749 msg="Notifier manager stopped" 2024-02-22T19:06:54.996 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 22 19:06:54 smithi111 bash[28960]: level=info ts=2024-02-22T19:06:54.847Z caller=main.go:761 msg="See you next time!" 2024-02-22T19:06:55.461 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@prometheus.a.service' 2024-02-22T19:06:55.495 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:06:55.496 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-02-22T19:06:55.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 --force --keep-logs 2024-02-22T19:06:55.632 INFO:teuthology.orchestra.run.smithi040.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-02-22T19:06:55.632 INFO:teuthology.orchestra.run.smithi040.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-02-22T19:06:55.632 INFO:teuthology.orchestra.run.smithi040.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-02-22T19:06:55.632 INFO:teuthology.orchestra.run.smithi040.stderr: [--retry RETRY] [--env ENV] 2024-02-22T19:06:55.632 INFO:teuthology.orchestra.run.smithi040.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install,registry-login,gather-facts} 2024-02-22T19:06:55.633 INFO:teuthology.orchestra.run.smithi040.stderr: ... 2024-02-22T19:06:55.633 INFO:teuthology.orchestra.run.smithi040.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-02-22T19:06:55.642 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-22T19:06:55.642 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 --force --keep-logs 2024-02-22T19:06:55.773 INFO:teuthology.orchestra.run.smithi111.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-02-22T19:06:55.774 INFO:teuthology.orchestra.run.smithi111.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-02-22T19:06:55.774 INFO:teuthology.orchestra.run.smithi111.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-02-22T19:06:55.774 INFO:teuthology.orchestra.run.smithi111.stderr: [--retry RETRY] [--env ENV] 2024-02-22T19:06:55.774 INFO:teuthology.orchestra.run.smithi111.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install,registry-login,gather-facts} 2024-02-22T19:06:55.774 INFO:teuthology.orchestra.run.smithi111.stderr: ... 2024-02-22T19:06:55.774 INFO:teuthology.orchestra.run.smithi111.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-02-22T19:06:55.784 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-22T19:06:55.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:06:55.801 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:06:55.815 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-22T19:06:55.817 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949/remote/ubuntu@smithi040.front.sepia.ceph.com/crash 2024-02-22T19:06:55.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/crash -- . 2024-02-22T19:06:55.836 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949/remote/ubuntu@smithi111.front.sepia.ceph.com/crash 2024-02-22T19:06:55.837 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/crash -- . 2024-02-22T19:06:55.854 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-22T19:06:55.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v 'mons down' | egrep -v 'pg inactive' | egrep -v 'out of quorum' | egrep -v '\(OSD_' | egrep -v 'osds down' | egrep -v 'osd down' | head -n 1 2024-02-22T19:06:55.896 INFO:teuthology.orchestra.run.smithi040.stdout:2024-02-22T18:40:00.000206+0000 mon.a (mon.0) 307 : cluster [WRN] pg 1.0 is stuck inactive for 83s, current state undersized+peered, last acting [0] 2024-02-22T19:06:55.897 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-22T19:06:55.897 INFO:tasks.cephadm:Compressing logs... 2024-02-22T19:06:55.897 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-22T19:06:55.899 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-22T19:06:55.909 INFO:teuthology.orchestra.run.smithi040.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-02-22T19:06:55.916 INFO:teuthology.orchestra.run.smithi111.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-02-22T19:06:55.919 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mon.a.log 2024-02-22T19:06:55.919 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi040.pyjfss.log 2024-02-22T19:06:55.920 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mon.b.log 2024-02-22T19:06:55.924 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi111.qafphs.log 2024-02-22T19:06:55.924 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.5.log 2024-02-22T19:06:55.924 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mgr.x.log 2024-02-22T19:06:55.924 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi111.qafphs.log: /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.audit.log 2024-02-22T19:06:55.924 INFO:teuthology.orchestra.run.smithi111.stderr: 58.2% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi111.qafphs.log.gz 2024-02-22T19:06:55.924 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.6.log 2024-02-22T19:06:55.925 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/rbd-target-api.log 2024-02-22T19:06:55.925 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mgr.y.log 2024-02-22T19:06:55.925 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi040.pyjfss.log: gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mon.c.log 2024-02-22T19:06:55.925 INFO:teuthology.orchestra.run.smithi040.stderr: 57.9% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi040.pyjfss.log.gz 2024-02-22T19:06:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.audit.log 2024-02-22T19:06:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mgr.y.log: /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.1.log 2024-02-22T19:06:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.log 2024-02-22T19:06:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.audit.log: /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.cephadm.log 2024-02-22T19:06:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.0.log 2024-02-22T19:06:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.3.log 2024-02-22T19:06:55.927 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.cephadm.log: /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.0.log: 90.4% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.cephadm.log.gz 2024-02-22T19:06:55.927 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-volume.log 2024-02-22T19:06:55.928 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.audit.log: /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.log 2024-02-22T19:06:55.928 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/rbd-target-api.log: 91.6% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/rbd-target-api.log.gz 2024-02-22T19:06:55.928 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.cephadm.log 2024-02-22T19:06:55.932 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.log: gzip -5 --verbose -- 90.6% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.audit.log.gz 2024-02-22T19:06:55.932 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.4.log /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.cephadm.log: 2024-02-22T19:06:55.932 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 82.4% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.cephadm.log.gz 2024-02-22T19:06:55.932 INFO:teuthology.orchestra.run.smithi111.stderr:--verbose /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.4.log: 89.8% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.log.gz 2024-02-22T19:06:55.933 INFO:teuthology.orchestra.run.smithi111.stderr:-- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-volume.log 2024-02-22T19:06:55.934 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.3.log: 94.1% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.log.gz 2024-02-22T19:06:55.934 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.7.log 2024-02-22T19:06:55.934 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-22T19:06:55.935 INFO:teuthology.orchestra.run.smithi040.stderr: 93.9% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph.audit.log.gz 2024-02-22T19:06:55.935 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.2.log 2024-02-22T19:06:55.939 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.7.log: /var/log/ceph/cephadm.log: 89.6% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-volume.log.gz 2024-02-22T19:06:55.939 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-22T19:06:55.942 INFO:teuthology.orchestra.run.smithi111.stderr: 90.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-22T19:06:55.942 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.2.log: 90.4% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-volume.log.gz 2024-02-22T19:06:55.949 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/cephadm.log: 90.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-22T19:06:55.998 INFO:teuthology.orchestra.run.smithi111.stderr: 91.2% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mgr.x.log.gz 2024-02-22T19:06:56.156 INFO:teuthology.orchestra.run.smithi040.stderr: 92.7% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mon.c.log.gz 2024-02-22T19:06:56.179 INFO:teuthology.orchestra.run.smithi111.stderr: 92.7% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mon.b.log.gz 2024-02-22T19:06:56.222 INFO:teuthology.orchestra.run.smithi040.stderr: 92.6% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mgr.y.log.gz 2024-02-22T19:06:56.602 INFO:teuthology.orchestra.run.smithi111.stderr: 92.7% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.6.log.gz 2024-02-22T19:06:56.631 INFO:teuthology.orchestra.run.smithi040.stderr: 92.4% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.2.log.gz 2024-02-22T19:06:56.634 INFO:teuthology.orchestra.run.smithi111.stderr: 92.8% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.5.log.gz 2024-02-22T19:06:56.647 INFO:teuthology.orchestra.run.smithi111.stderr: 93.1% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.7.log.gz 2024-02-22T19:06:56.729 INFO:teuthology.orchestra.run.smithi040.stderr: 90.9% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-mon.a.log.gz 2024-02-22T19:06:56.755 INFO:teuthology.orchestra.run.smithi040.stderr: 93.1% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.0.log.gz 2024-02-22T19:06:56.822 INFO:teuthology.orchestra.run.smithi111.stderr: 93.4% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.4.log.gz 2024-02-22T19:06:56.824 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-02-22T19:06:56.824 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m0.919s 2024-02-22T19:06:56.824 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m3.258s 2024-02-22T19:06:56.824 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m0.138s 2024-02-22T19:06:56.886 INFO:teuthology.orchestra.run.smithi040.stderr: 93.4% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.1.log.gz 2024-02-22T19:06:57.040 INFO:teuthology.orchestra.run.smithi040.stderr: 93.3% -- replaced with /var/log/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/ceph-osd.3.log.gz 2024-02-22T19:06:57.041 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-22T19:06:57.041 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m1.140s 2024-02-22T19:06:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m4.819s 2024-02-22T19:06:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.182s 2024-02-22T19:06:57.042 INFO:tasks.cephadm:Archiving logs... 2024-02-22T19:06:57.042 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949/remote/ubuntu@smithi040.front.sepia.ceph.com/log 2024-02-22T19:06:57.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-22T19:06:57.709 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949/remote/ubuntu@smithi111.front.sepia.ceph.com/log 2024-02-22T19:06:57.710 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-22T19:06:58.222 INFO:tasks.cephadm:Removing cluster... 2024-02-22T19:06:58.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 --force 2024-02-22T19:07:00.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 19:06:59 smithi040 systemd[1]: Stopping Ceph node-exporter.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:07:01.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 19:07:00 smithi040 bash[47759]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-node-exporter.a 2024-02-22T19:07:01.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 19:07:00 smithi040 bash[47806]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/node-exporter.a/unit.stop: No such file or directory 2024-02-22T19:07:01.180 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 19:07:01 smithi040 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2024-02-22T19:07:01.180 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 19:07:01 smithi040 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-22T19:07:01.180 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 22 19:07:01 smithi040 systemd[1]: Stopped Ceph node-exporter.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:07:01.606 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:07:01 smithi040 systemd[1]: Stopping Ceph alertmanager.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:07:01.606 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:07:01 smithi040 bash[29235]: level=info ts=2024-02-22T19:07:01.373Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2024-02-22T19:07:02.338 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:07:01 smithi040 bash[47833]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-alertmanager.a 2024-02-22T19:07:02.338 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:07:01 smithi040 bash[47879]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/alertmanager.a/unit.stop: No such file or directory 2024-02-22T19:07:02.339 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:07:02 smithi040 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-22T19:07:02.339 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 22 19:07:02 smithi040 systemd[1]: Stopped Ceph alertmanager.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:07:14.041 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 --force 2024-02-22T19:07:15.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:07:15 smithi111 systemd[1]: Stopping Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:07:26.597 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:07:26 smithi111 bash[39530]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a 2024-02-22T19:07:26.598 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:07:26 smithi111 bash[39580]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/iscsi.iscsi.a/unit.stop: No such file or directory 2024-02-22T19:07:26.598 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:07:26 smithi111 bash[38246]: (process:1): GLib-GObject-CRITICAL **: 19:07:26.569: g_object_unref: assertion 'G_IS_OBJECT (object)' failed 2024-02-22T19:07:26.964 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:07:26 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-02-22T19:07:26.990 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:07:26 smithi111 bash[39582]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-iscsi.iscsi.a-tcmu 2024-02-22T19:07:27.238 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:07:26 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-22T19:07:27.238 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 22 19:07:26 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:07:27.535 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 19:07:27 smithi111 systemd[1]: Stopping Ceph node-exporter.b for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:07:28.214 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 19:07:27 smithi111 bash[39674]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-node-exporter.b 2024-02-22T19:07:28.214 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 19:07:27 smithi111 bash[39722]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/node-exporter.b/unit.stop: No such file or directory 2024-02-22T19:07:28.214 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 19:07:28 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2024-02-22T19:07:28.214 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 19:07:28 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-22T19:07:28.215 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 22 19:07:28 smithi111 systemd[1]: Stopped Ceph node-exporter.b for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:07:28.714 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 systemd[1]: Stopping Ceph grafana.a for 42039b9c-d1b1-11ee-95bf-87774f69a715... 2024-02-22T19:07:28.714 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-02-22T19:07:28.714 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" 2024-02-22T19:07:28.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped Stream Manager" 2024-02-22T19:07:28.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped PluginManager" logger=server reason="context canceled" 2024-02-22T19:07:28.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" 2024-02-22T19:07:28.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped AlertEngine" logger=server reason="context canceled" 2024-02-22T19:07:28.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped UserAuthTokenService" logger=server reason="context canceled" 2024-02-22T19:07:28.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped CleanUpService" logger=server reason="context canceled" 2024-02-22T19:07:28.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" 2024-02-22T19:07:28.715 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped InternalMetricsService" logger=server reason="context canceled" 2024-02-22T19:07:28.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped provisioningServiceImpl" logger=server reason="context canceled" 2024-02-22T19:07:28.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=info msg="Stopped RemoteCache" logger=server reason="context canceled" 2024-02-22T19:07:28.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[24494]: t=2024-02-22T19:07:28+0000 lvl=eror msg="Server shutdown" logger=server reason=nil 2024-02-22T19:07:29.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[39748]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715-grafana.a 2024-02-22T19:07:29.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:28 smithi111 bash[39793]: bash: /var/lib/ceph/42039b9c-d1b1-11ee-95bf-87774f69a715/grafana.a/unit.stop: No such file or directory 2024-02-22T19:07:29.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:29 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:07:29.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:29 smithi111 systemd[1]: ceph-42039b9c-d1b1-11ee-95bf-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-02-22T19:07:29.214 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 22 19:07:29 smithi111 systemd[1]: Stopped Ceph grafana.a for 42039b9c-d1b1-11ee-95bf-87774f69a715. 2024-02-22T19:07:40.871 INFO:tasks.cephadm:Removing cephadm ... 2024-02-22T19:07:40.871 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-22T19:07:40.879 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-22T19:07:40.884 INFO:tasks.cephadm:Teardown complete 2024-02-22T19:07:40.885 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-22T19:07:40.894 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-22T19:07:40.894 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T19:07:40.897 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T19:07:40.916 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2024-02-22T19:07:40.916 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2024-02-22T19:07:40.916 INFO:teuthology.orchestra.run.smithi040.stdout:*hv01.front.sepi 44.4.53.2 2 u 59 64 377 0.096 4.104 0.425 2024-02-22T19:07:40.916 INFO:teuthology.orchestra.run.smithi040.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 377 0.073 3.860 0.294 2024-02-22T19:07:40.916 INFO:teuthology.orchestra.run.smithi040.stdout:+hv03.front.sepi 74.6.168.72 3 u 48 64 377 0.106 2.223 0.454 2024-02-22T19:07:40.917 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2024-02-22T19:07:40.918 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-02-22T19:07:40.918 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-02-22T19:07:40.918 INFO:teuthology.orchestra.run.smithi111.stdout:*hv01.front.sepi 44.4.53.2 2 u 45 64 377 0.085 2.176 0.744 2024-02-22T19:07:40.918 INFO:teuthology.orchestra.run.smithi111.stdout:+hv02.front.sepi 63.231.80.2 3 u 40 64 377 0.095 1.369 0.864 2024-02-22T19:07:40.918 INFO:teuthology.orchestra.run.smithi111.stdout:+hv03.front.sepi 74.6.168.72 3 u 54 64 377 0.091 0.118 0.684 2024-02-22T19:07:40.918 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2024-02-22T19:07:40.919 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-22T19:07:40.944 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-22T19:07:40.945 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-22T19:07:40.977 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-22T19:07:41.011 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-22T19:07:41.044 INFO:teuthology.task.internal:Duration was 2220.732261 seconds 2024-02-22T19:07:41.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-22T19:07:41.078 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-22T19:07:41.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-22T19:07:41.080 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-22T19:07:41.135 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-22T19:07:41.136 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-02-22T19:07:41.136 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-22T19:07:41.146 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-02-22T19:07:41.146 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-22T19:07:41.160 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-22T19:07:41.160 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-22T19:07:41.162 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-22T19:07:41.224 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-22T19:07:41.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-22T19:07:41.226 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-22T19:07:41.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-22T19:07:41.371 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-22T19:07:41.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-22T19:07:41.384 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-22T19:07:41.401 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-22T19:07:41.420 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-22T19:07:41.428 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-22T19:07:41.441 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-02-22T19:07:41.443 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-02-22T19:07:41.476 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-22T19:07:41.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T19:07:41.482 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-22T19:07:41.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T19:07:41.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-22T19:07:41.525 INFO:teuthology.task.internal:Transferring archived files... 2024-02-22T19:07:41.526 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949/remote/smithi040 2024-02-22T19:07:41.527 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-22T19:07:41.557 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949/remote/smithi111 2024-02-22T19:07:41.558 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-22T19:07:41.587 INFO:teuthology.task.internal:Removing archive directory... 2024-02-22T19:07:41.587 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-22T19:07:41.589 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-22T19:07:41.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-22T19:07:41.606 INFO:teuthology.task.internal:Not uploading archives. 2024-02-22T19:07:41.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-22T19:07:41.637 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-22T19:07:41.637 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-22T19:07:41.639 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-22T19:07:41.645 INFO:teuthology.orchestra.run.smithi040.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 19:07 /home/ubuntu/cephtest 2024-02-22T19:07:41.647 INFO:teuthology.orchestra.run.smithi111.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 19:07 /home/ubuntu/cephtest 2024-02-22T19:07:41.649 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-22T19:07:41.671 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-22T19:07:41.739 INFO:teuthology.nuke:Checking targets against current locks 2024-02-22T19:07:41.765 DEBUG:teuthology.nuke:shortname: smithi040 2024-02-22T19:07:41.766 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-22T19:07:41.789 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-22 18:18:38.030787', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-02-22T19:07:41.793 DEBUG:teuthology.nuke:shortname: smithi111 2024-02-22T19:07:41.793 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-22T19:07:41.817 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-22 18:18:38.032583', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-02-22T19:07:41.842 INFO:teuthology.orchestra.console.smithi040:Power off 2024-02-22T19:07:41.842 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-22T19:07:41.868 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-02-22T19:07:41.869 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:07:41.884 INFO:teuthology.orchestra.console.smithi111:Power off 2024-02-22T19:07:41.885 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-22T19:07:41.894 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-02-22T19:07:41.907 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-02-22T19:07:41.908 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:07:41.931 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-02-22T19:07:45.895 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:07:45.932 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:07:46.005 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-02-22T19:07:46.041 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-02-22T19:07:50.008 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:07:50.042 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:07:50.130 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-02-22T19:07:50.151 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-02-22T19:07:54.135 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:07:54.152 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:07:54.246 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-02-22T19:07:54.262 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-02-22T19:07:54.347 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-02-22T19:07:54.363 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-02-22T19:07:54.468 INFO:teuthology.run:Summary data: description: rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} duration: 2220.732260942459 failure_reason: 'Command failed on smithi040 with status 22: ''sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42039b9c-d1b1-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c \''ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk \''"\''"\''{print $2}\''"\''"\'')\''''' owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ca3cd47f27794c52bd538165a2aeaeba status: fail success: false 2024-02-22T19:07:54.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T19:07:54.541 INFO:teuthology.run:FAIL